Aug 16 16:34:32 user nova-compute[73450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 16:34:34 user nova-compute[73450]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73450) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 16:34:34 user nova-compute[73450]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73450) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 16:34:34 user nova-compute[73450]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73450) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 16:34:34 user nova-compute[73450]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:34:35 user nova-compute[73450]: INFO nova.virt.driver [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 16:34:35 user nova-compute[73450]: INFO nova.compute.provider_config [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Acquiring lock "singleton_lock" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Acquired lock "singleton_lock" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Releasing lock "singleton_lock" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Full set of CONF: {{(pid=73450) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ******************************************************************************** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Configuration options gathered from: {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ================================================================================ {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] allow_resize_to_same_host      = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] arq_binding_timeout            = 300 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] backdoor_port                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] backdoor_socket                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] block_device_allocate_retries  = 300 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] block_device_allocate_retries_interval = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cert                           = self.pem {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute_monitors               = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] config_dir                     = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] config_drive_format            = iso9660 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] config_source                  = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] console_host                   = user {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] control_exchange               = nova {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cpu_allocation_ratio           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] daemon                         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] debug                          = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] default_access_ip_network_name = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] default_availability_zone      = nova {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] default_ephemeral_format       = ext4 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] default_schedule_zone          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] disk_allocation_ratio          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] enable_new_services            = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] enabled_ssl_apis               = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] flat_injected                  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] force_config_drive             = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] force_raw_images               = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] graceful_shutdown_timeout      = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] heal_instance_info_cache_interval = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] host                           = user {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_build_timeout         = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_delete_interval       = 300 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_name_template         = instance-%08x {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_usage_audit           = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_usage_audit_period    = month {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] internal_service_availability_zone = internal {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] key                            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] live_migration_retry_count     = 30 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_config_append              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_dir                        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_file                       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_options                    = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_rotate_interval            = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_rotate_interval_type       = days {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] log_rotation_type              = none {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] long_rpc_timeout               = 1800 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] max_concurrent_builds          = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] max_concurrent_live_migrations = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] max_concurrent_snapshots       = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] max_local_block_devices        = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] max_logfile_count              = 30 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] max_logfile_size_mb            = 200 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] maximum_instance_delete_attempts = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metadata_listen                = 0.0.0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metadata_listen_port           = 8775 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metadata_workers               = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] migrate_max_retries            = -1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] mkisofs_cmd                    = genisoimage {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] my_ip                          = 10.0.0.210 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] network_allocate_retries       = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] osapi_compute_listen_port      = 8774 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] osapi_compute_unique_server_name_scope =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] osapi_compute_workers          = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] password_length                = 12 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] periodic_enable                = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] periodic_fuzzy_delay           = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] pointer_model                  = ps2mouse {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] preallocate_images             = none {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] publish_errors                 = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] pybasedir                      = /opt/stack/nova {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ram_allocation_ratio           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rate_limit_burst               = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rate_limit_except_level        = CRITICAL {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rate_limit_interval            = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reboot_timeout                 = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reclaim_instance_interval      = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] record                         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reimage_timeout_per_gb         = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] report_interval                = 120 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rescue_timeout                 = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reserved_host_cpus             = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reserved_host_disk_mb          = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reserved_host_memory_mb        = 512 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] reserved_huge_pages            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] resize_confirm_window          = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] resize_fs_using_block_device   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] resume_guests_state_on_host_boot = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rpc_response_timeout           = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] run_external_periodic_tasks    = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] running_deleted_instance_action = reap {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] running_deleted_instance_timeout = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler_instance_sync_interval = 120 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_down_time              = 720 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] servicegroup_driver            = db {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] shelved_offload_time           = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] shelved_poll_interval          = 3600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] shutdown_timeout               = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] source_is_ipv6                 = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ssl_only                       = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] state_path                     = /opt/stack/data/nova {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] sync_power_state_interval      = 600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] sync_power_state_pool_size     = 1000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] syslog_log_facility            = LOG_USER {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] tempdir                        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] timeout_nbd                    = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] transport_url                  = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] update_resources_interval      = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_cow_images                 = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_eventlog                   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_journal                    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_json                       = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_rootwrap_daemon            = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_stderr                     = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] use_syslog                     = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vcpu_pin_set                   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plugging_is_fatal          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plugging_timeout           = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] virt_mkfs                      = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] volume_usage_poll_interval     = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] watch_log_file                 = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] web                            = /usr/share/spice-html5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_concurrency.disable_process_locking = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.auth_strategy              = keystone {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.compute_link_prefix        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.dhcp_domain                = novalocal {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.enable_instance_password   = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.glance_link_prefix         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.instance_list_per_project_cells = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.list_records_by_skipping_down_cells = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.local_metadata_per_cell    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.max_limit                  = 1000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.metadata_cache_expiration  = 15 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.neutron_default_tenant_id  = default {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.use_forwarded_for          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.use_neutron_default_nets   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_dynamic_targets = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_jsonfile_path   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.backend_argument         = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.config_prefix            = cache.oslo {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.dead_timeout             = 60.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.debug_cache_backend      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.enable_retry_client      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.enable_socket_keepalive  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.enabled                  = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.expiration_time          = 600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.hashclient_retry_attempts = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_dead_retry      = 300 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_password        =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_sasl_enabled    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.memcache_username        =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.proxies                  = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.retry_attempts           = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.retry_delay              = 0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.socket_keepalive_count   = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.socket_keepalive_idle    = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.socket_keepalive_interval = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.tls_allowed_ciphers      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.tls_cafile               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.tls_certfile             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.tls_enabled              = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cache.tls_keyfile              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.auth_section            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.auth_type               = password {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.cafile                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.certfile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.collect_timing          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.cross_az_attach         = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.debug                   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.endpoint_template       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.http_retries            = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.insecure                = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.keyfile                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.os_region_name          = RegionOne {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.split_loggers           = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cinder.timeout                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.cpu_dedicated_set      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.cpu_shared_set         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.image_type_exclude_list = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.resource_provider_association_refresh = 300 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.shutdown_retry_interval = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] conductor.workers              = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] console.allowed_origins        = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] console.ssl_ciphers            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] console.ssl_minimum_version    = default {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] consoleauth.token_ttl          = 600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.cafile                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.certfile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.collect_timing          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.connect_retries         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.connect_retry_delay     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.endpoint_override       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.insecure                = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.keyfile                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.max_version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.min_version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.region_name             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.service_name            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.service_type            = accelerator {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.split_loggers           = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.status_code_retries     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.timeout                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] cyborg.version                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.backend               = sqlalchemy {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.connection            = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.connection_debug      = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.connection_parameters =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.connection_recycle_time = 3600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.connection_trace      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.db_inc_retry_interval = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.db_max_retries        = 20 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.db_max_retry_interval = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.db_retry_interval     = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.max_overflow          = 50 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.max_pool_size         = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.max_retries           = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.mysql_enable_ndb      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.mysql_wsrep_sync_wait = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.pool_timeout          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.retry_interval        = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.slave_connection      = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] database.sqlite_synchronous    = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.backend           = sqlalchemy {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.connection        = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.connection_debug  = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.connection_parameters =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.connection_recycle_time = 3600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.connection_trace  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.db_inc_retry_interval = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.db_max_retries    = 20 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.db_max_retry_interval = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.db_retry_interval = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.max_overflow      = 50 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.max_pool_size     = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.max_retries       = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.mysql_enable_ndb  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.pool_timeout      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.retry_interval    = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.slave_connection  = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] api_database.sqlite_synchronous = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] devices.enabled_mdev_types     = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ephemeral_storage_encryption.enabled = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.api_servers             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.cafile                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.certfile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.collect_timing          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.connect_retries         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.connect_retry_delay     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.debug                   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.default_trusted_certificate_ids = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.enable_certificate_validation = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.enable_rbd_download     = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.endpoint_override       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.insecure                = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.keyfile                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.max_version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.min_version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.num_retries             = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.rbd_ceph_conf           =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.rbd_connect_timeout     = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.rbd_pool                =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.rbd_user                =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.region_name             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.service_name            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.service_type            = image {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.split_loggers           = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.status_code_retries     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.timeout                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.verify_glance_signatures = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] glance.version                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] guestfs.debug                  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.config_drive_cdrom      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.config_drive_inject_password = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.enable_remotefx         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.instances_path_share    =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.limit_cpu_features      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.use_multipath_io        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.vswitch_name            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] mks.enabled                    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] image_cache.manager_interval   = 2400 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] image_cache.precache_concurrency = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] image_cache.remove_unused_base_images = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] image_cache.subdirectory_name  = _base {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.api_max_retries         = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.api_retry_interval      = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.auth_section            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.auth_type               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.cafile                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.certfile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.collect_timing          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.connect_retries         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.connect_retry_delay     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.endpoint_override       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.insecure                = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.keyfile                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.max_version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.min_version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.partition_key           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.peer_list               = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.region_name             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.serial_console_state_timeout = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.service_name            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.service_type            = baremetal {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.split_loggers           = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.status_code_retries     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.timeout                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ironic.version                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] key_manager.fixed_key          = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.barbican_api_version  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.barbican_endpoint     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.barbican_endpoint_type = public {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.barbican_region_name  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.cafile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.certfile              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.collect_timing        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.insecure              = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.keyfile               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.number_of_retries     = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.retry_delay           = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.send_service_user_token = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.split_loggers         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.timeout               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.verify_ssl            = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican.verify_ssl_path       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.auth_section = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.auth_type = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.cafile   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.certfile = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.collect_timing = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.insecure = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.keyfile  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.split_loggers = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] barbican_service_user.timeout  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.approle_role_id          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.approle_secret_id        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.cafile                   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.certfile                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.collect_timing           = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.insecure                 = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.keyfile                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.kv_mountpoint            = secret {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.kv_version               = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.namespace                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.root_token_id            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.split_loggers            = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.ssl_ca_crt_file          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.timeout                  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.use_ssl                  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.cafile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.certfile              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.collect_timing        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.connect_retries       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.connect_retry_delay   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.endpoint_override     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.insecure              = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.keyfile               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.max_version           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.min_version           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.region_name           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.service_name          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.service_type          = identity {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.split_loggers         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.status_code_retries   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.timeout               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] keystone.version               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.connection_uri         =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_mode               = custom {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: WARNING oslo_config.cfg [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_power_governor_high = performance {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_power_management   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.device_detach_attempts = 8 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.device_detach_timeout  = 20 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.disk_cachemodes        = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.disk_prefix            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.enabled_perf_events    = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.file_backed_memory     = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.gid_maps               = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.hw_disk_discard        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.hw_machine_type        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_rbd_pool        = rbd {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_type            = default {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.images_volume_group    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.inject_key             = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.inject_partition       = -2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.inject_password        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.iscsi_iface            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.iser_use_multipath     = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_downtime = 500 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_inbound_addr = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_scheme  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_timeout_action = abort {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_tunnelled = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: WARNING oslo_config.cfg [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 16:34:35 user nova-compute[73450]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 16:34:35 user nova-compute[73450]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 16:34:35 user nova-compute[73450]: and ``live_migration_inbound_addr`` respectively.
Aug 16 16:34:35 user nova-compute[73450]: ).  Its value may be silently ignored in the future.
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.live_migration_with_native_tls = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.max_queues             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.nfs_mount_options      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.num_pcie_ports         = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.pmem_namespaces        = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.quobyte_client_cfg     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rbd_secret_uuid        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rbd_user               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rescue_image_id        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rescue_kernel_id       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.rx_queue_size          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.smbfs_mount_options    =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.snapshot_compression   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.snapshot_image_format  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.sparse_logical_volumes = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.swtpm_enabled          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.swtpm_group            = tss {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.swtpm_user             = tss {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.sysinfo_serial         = unique {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.tb_cache_size          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.tx_queue_size          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.uid_maps               = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.use_virtio_for_bridges = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.virt_type              = kvm {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.volume_clear           = zero {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.volume_clear_size      = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.volume_use_multipath   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_cache_path   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.auth_section           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.auth_type              = password {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.cafile                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.certfile               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.collect_timing         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.connect_retries        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.connect_retry_delay    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.default_floating_pool  = public {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.endpoint_override      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.extension_sync_interval = 600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.http_retries           = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.insecure               = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.keyfile                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.max_version            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.min_version            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.ovs_bridge             = br-int {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.physnets               = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.region_name            = RegionOne {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.service_metadata_proxy = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.service_name           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.service_type           = network {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.split_loggers          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.status_code_retries    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.timeout                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] neutron.version                = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] notifications.bdms_in_notifications = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] notifications.default_level    = INFO {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] notifications.notification_format = unversioned {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] notifications.notify_on_state_change = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] pci.alias                      = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] pci.device_spec                = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] pci.report_in_placement        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.auth_section         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.auth_type            = password {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.cafile               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.certfile             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.collect_timing       = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.connect_retries      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.connect_retry_delay  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.default_domain_id    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.default_domain_name  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.domain_id            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.domain_name          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.endpoint_override    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.insecure             = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.keyfile              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.max_version          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.min_version          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.password             = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.project_domain_id    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.project_domain_name  = Default {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.project_id           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.project_name         = service {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.region_name          = RegionOne {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.service_name         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.service_type         = placement {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.split_loggers        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.status_code_retries  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.system_scope         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.timeout              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.trust_id             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.user_domain_id       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.user_domain_name     = Default {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.user_id              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.username             = placement {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] placement.version              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.cores                    = 20 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.count_usage_from_placement = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.injected_file_content_bytes = 10240 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.injected_file_path_length = 255 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.injected_files           = 5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.instances                = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.key_pairs                = 100 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.metadata_items           = 128 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.ram                      = 51200 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.recheck_quota            = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.server_group_members     = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] quota.server_groups            = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rdp.enabled                    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.image_metadata_prefilter = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.max_attempts         = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.max_placement_results = 1000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] scheduler.workers              = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.host_subset_size = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.isolated_hosts = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.isolated_images = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.pci_in_placement = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.track_instance_changes = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metrics.required               = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metrics.weight_multiplier      = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] metrics.weight_setting         = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] serial_console.enabled         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] serial_console.port_range      = 10000:20000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] serial_console.serialproxy_port = 6083 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.auth_section      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.auth_type         = password {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.cafile            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.certfile          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.collect_timing    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.insecure          = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.keyfile           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.send_service_user_token = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.split_loggers     = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] service_user.timeout           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.agent_enabled            = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.enabled                  = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.html5proxy_port          = 6082 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.image_compression        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.jpeg_compression         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.playback_compression     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.server_listen            = 127.0.0.1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.streaming_mode           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] spice.zlib_compression         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] upgrade_levels.baseapi         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] upgrade_levels.cert            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] upgrade_levels.compute         = auto {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] upgrade_levels.conductor       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] upgrade_levels.scheduler       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.cafile = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.certfile = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.insecure = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vendordata_dynamic_auth.timeout = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.api_retry_count         = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.ca_file                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.cache_prefix            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.cluster_name            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.connection_pool_size    = 10 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.console_delay_seconds   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.datastore_regex         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.host_ip                 = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.host_password           = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.host_port               = 443 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.host_username           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.insecure                = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.integration_bridge      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.maximum_objects         = 100 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.pbm_default_policy      = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.pbm_enabled             = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.pbm_wsdl_location       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.serial_port_proxy_uri   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.serial_port_service_uri = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.task_poll_interval      = 0.5 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.use_linked_clone        = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.vnc_keymap              = en-us {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.vnc_port                = 5900 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vmware.vnc_port_total          = 10000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.auth_schemes               = ['none'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.enabled                    = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.novncproxy_port            = 6080 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.vencrypt_ca_certs          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.vencrypt_client_cert       = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vnc.vencrypt_client_key        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.disable_rootwrap   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.enable_numa_live_migration = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.libvirt_disable_apic = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.client_socket_timeout     = 900 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.default_pool_size         = 1000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.keep_alive                = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.max_header_line           = 16384 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.ssl_ca_file               = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.ssl_cert_file             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.ssl_key_file              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.tcp_keepidle              = 600 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] zvm.ca_file                    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] zvm.cloud_connector_url        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] zvm.reachable_timeout          = 300 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.enforce_new_defaults = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.enforce_scope      = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.policy_default_rule = default {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.connection_string     = messaging:// {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.enabled               = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.es_doc_type           = notification {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.es_scroll_size        = 10000 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.es_scroll_time        = 2m {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.filter_error_trace    = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.hmac_keys             = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.sentinel_service_name = mymaster {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.socket_timeout        = 0.1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.trace_requests        = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler.trace_sqlalchemy      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler_jaeger.process_tags   = {} {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler_jaeger.service_name_prefix = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] profiler_otlp.service_name_prefix = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] remote_debug.host              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] remote_debug.port              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_notifications.retry = -1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.auth_section        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.auth_type           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.cafile              = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.certfile            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.collect_timing      = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.connect_retries     = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.connect_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.endpoint_id         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.endpoint_override   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.insecure            = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.keyfile             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.max_version         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.min_version         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.region_name         = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.service_name        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.service_type        = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.split_loggers       = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.status_code_retries = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.status_code_retry_delay = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.timeout             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.valid_interfaces    = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_limit.version             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_reports.file_event_handler = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] oslo_reports.log_dir           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_ovs_privileged.group  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] vif_plug_ovs_privileged.user   = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_ovs.isolate_vif         = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] os_brick.lock_path             = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] privsep_osbrick.capabilities   = [21] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] privsep_osbrick.group          = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] privsep_osbrick.helper_command = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] privsep_osbrick.user           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] nova_sys_admin.group           = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] nova_sys_admin.helper_command  = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] nova_sys_admin.user            = None {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG oslo_service.service [None req-05f3be9b-40e2-4e56-b5f3-19d31296d463 None None] ******************************************************************************** {{(pid=73450) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 16:34:35 user nova-compute[73450]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Starting native event thread {{(pid=73450) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Starting green dispatch thread {{(pid=73450) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Starting connection event dispatch thread {{(pid=73450) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Connecting to libvirt: qemu:///system {{(pid=73450) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe282134f10> {{(pid=73450) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe282134f10> {{(pid=73450) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 16:34:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Connection event '1' reason 'None'
Aug 16 16:34:35 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 16:34:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.mount [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Initialising _HostMountState generation 0 {{(pid=73450) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 16:34:43 user nova-compute[73450]: INFO nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host capabilities <capabilities>
Aug 16 16:34:43 user nova-compute[73450]:   <host>
Aug 16 16:34:43 user nova-compute[73450]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 16:34:43 user nova-compute[73450]:     <cpu>
Aug 16 16:34:43 user nova-compute[73450]:       <arch>x86_64</arch>
Aug 16 16:34:43 user nova-compute[73450]:       <model>IvyBridge-IBRS</model>
Aug 16 16:34:43 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:43 user nova-compute[73450]:       <microcode version='1070'/>
Aug 16 16:34:43 user nova-compute[73450]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 16:34:43 user nova-compute[73450]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='ss'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='vmx'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='pcid'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='osxsave'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='hypervisor'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='arat'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='tsc_adjust'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='md-clear'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='stibp'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='arch-capabilities'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='ssbd'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='invtsc'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='rsba'/>
Aug 16 16:34:43 user nova-compute[73450]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 16:34:43 user nova-compute[73450]:       <pages unit='KiB' size='4'/>
Aug 16 16:34:43 user nova-compute[73450]:       <pages unit='KiB' size='2048'/>
Aug 16 16:34:43 user nova-compute[73450]:     </cpu>
Aug 16 16:34:43 user nova-compute[73450]:     <power_management>
Aug 16 16:34:43 user nova-compute[73450]:       <suspend_mem/>
Aug 16 16:34:43 user nova-compute[73450]:       <suspend_disk/>
Aug 16 16:34:43 user nova-compute[73450]:       <suspend_hybrid/>
Aug 16 16:34:43 user nova-compute[73450]:     </power_management>
Aug 16 16:34:43 user nova-compute[73450]:     <iommu support='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     <migration_features>
Aug 16 16:34:43 user nova-compute[73450]:       <live/>
Aug 16 16:34:43 user nova-compute[73450]:       <uri_transports>
Aug 16 16:34:43 user nova-compute[73450]:         <uri_transport>tcp</uri_transport>
Aug 16 16:34:43 user nova-compute[73450]:         <uri_transport>rdma</uri_transport>
Aug 16 16:34:43 user nova-compute[73450]:       </uri_transports>
Aug 16 16:34:43 user nova-compute[73450]:     </migration_features>
Aug 16 16:34:43 user nova-compute[73450]:     <topology>
Aug 16 16:34:43 user nova-compute[73450]:       <cells num='2'>
Aug 16 16:34:43 user nova-compute[73450]:         <cell id='0'>
Aug 16 16:34:43 user nova-compute[73450]:           <memory unit='KiB'>8140616</memory>
Aug 16 16:34:43 user nova-compute[73450]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 16 16:34:43 user nova-compute[73450]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 16:34:43 user nova-compute[73450]:           <distances>
Aug 16 16:34:43 user nova-compute[73450]:             <sibling id='0' value='10'/>
Aug 16 16:34:43 user nova-compute[73450]:             <sibling id='1' value='20'/>
Aug 16 16:34:43 user nova-compute[73450]:           </distances>
Aug 16 16:34:43 user nova-compute[73450]:           <cpus num='6'>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 16:34:43 user nova-compute[73450]:           </cpus>
Aug 16 16:34:43 user nova-compute[73450]:         </cell>
Aug 16 16:34:43 user nova-compute[73450]:         <cell id='1'>
Aug 16 16:34:43 user nova-compute[73450]:           <memory unit='KiB'>8255068</memory>
Aug 16 16:34:43 user nova-compute[73450]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 16 16:34:43 user nova-compute[73450]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 16:34:43 user nova-compute[73450]:           <distances>
Aug 16 16:34:43 user nova-compute[73450]:             <sibling id='0' value='20'/>
Aug 16 16:34:43 user nova-compute[73450]:             <sibling id='1' value='10'/>
Aug 16 16:34:43 user nova-compute[73450]:           </distances>
Aug 16 16:34:43 user nova-compute[73450]:           <cpus num='6'>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 16:34:43 user nova-compute[73450]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 16:34:43 user nova-compute[73450]:           </cpus>
Aug 16 16:34:43 user nova-compute[73450]:         </cell>
Aug 16 16:34:43 user nova-compute[73450]:       </cells>
Aug 16 16:34:43 user nova-compute[73450]:     </topology>
Aug 16 16:34:43 user nova-compute[73450]:     <cache>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 16:34:43 user nova-compute[73450]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 16:34:43 user nova-compute[73450]:     </cache>
Aug 16 16:34:43 user nova-compute[73450]:     <secmodel>
Aug 16 16:34:43 user nova-compute[73450]:       <model>apparmor</model>
Aug 16 16:34:43 user nova-compute[73450]:       <doi>0</doi>
Aug 16 16:34:43 user nova-compute[73450]:     </secmodel>
Aug 16 16:34:43 user nova-compute[73450]:     <secmodel>
Aug 16 16:34:43 user nova-compute[73450]:       <model>dac</model>
Aug 16 16:34:43 user nova-compute[73450]:       <doi>0</doi>
Aug 16 16:34:43 user nova-compute[73450]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 16:34:43 user nova-compute[73450]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 16:34:43 user nova-compute[73450]:     </secmodel>
Aug 16 16:34:43 user nova-compute[73450]:   </host>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='alpha'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>clipper</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='armv6l'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>spitz</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>nuri</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>kzm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sx1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>z2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>tosa</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>n810</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>n800</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>terrier</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>midway</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>microbit</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>verdex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>highbank</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>akita</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>connex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>collie</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='armv7l'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>spitz</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>nuri</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>kzm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sx1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>z2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>tosa</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>n810</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>n800</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>terrier</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>midway</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>microbit</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>verdex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>highbank</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>akita</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>connex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>collie</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='aarch64'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>spitz</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>nuri</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>kzm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sx1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>z2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>tosa</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>n810</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>n800</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>terrier</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>midway</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>microbit</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>verdex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='4'>highbank</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>akita</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>connex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>collie</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <acpi default='on' toggle='yes'/>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='cris'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='i686'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>isapc</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>microvm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='kvm'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <pae/>
Aug 16 16:34:43 user nova-compute[73450]:       <nonpae/>
Aug 16 16:34:43 user nova-compute[73450]:       <acpi default='on' toggle='yes'/>
Aug 16 16:34:43 user nova-compute[73450]:       <apic default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='m68k'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>an5206</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>q800</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='microblaze'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='microblazeel'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='mips'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='16'>malta</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='mipsel'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='16'>malta</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='mips64'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='16'>malta</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>pica61</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>magnum</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='mips64el'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='16'>malta</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>pica61</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>magnum</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='16'>boston</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='ppc'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mac99</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>40p</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>taihu</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='ppc64'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>taihu</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>40p</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mac99</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='ppc64le'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>taihu</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>40p</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>mac99</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='riscv32'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='8'>spike</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='8'>virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='riscv64'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='8'>spike</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='8'>virt</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:43 user nova-compute[73450]:     </arch>
Aug 16 16:34:43 user nova-compute[73450]:     <features>
Aug 16 16:34:43 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:43 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:43 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:43 user nova-compute[73450]:     </features>
Aug 16 16:34:43 user nova-compute[73450]:   </guest>
Aug 16 16:34:43 user nova-compute[73450]:   <guest>
Aug 16 16:34:43 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:43 user nova-compute[73450]:     <arch name='s390x'>
Aug 16 16:34:43 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:43 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 16:34:43 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='sh4'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>shix</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>r2d</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='sh4eb'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>shix</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>r2d</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='sparc'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>LX</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='sparc64'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>niagara</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='x86_64'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>64</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='1'>isapc</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>microvm</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='kvm'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <acpi default='on' toggle='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:       <apic default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='xtensa'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='4'>sim</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>kc705</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>ml605</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>virt</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx200</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx60</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]:   <guest>
Aug 16 16:34:44 user nova-compute[73450]:     <os_type>hvm</os_type>
Aug 16 16:34:44 user nova-compute[73450]:     <arch name='xtensaeb'>
Aug 16 16:34:44 user nova-compute[73450]:       <wordsize>32</wordsize>
Aug 16 16:34:44 user nova-compute[73450]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='4'>sim</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>kc705</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>ml605</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>virt</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx200</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>lx60</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 16:34:44 user nova-compute[73450]:       <domain type='qemu'/>
Aug 16 16:34:44 user nova-compute[73450]:     </arch>
Aug 16 16:34:44 user nova-compute[73450]:     <features>
Aug 16 16:34:44 user nova-compute[73450]:       <cpuselection/>
Aug 16 16:34:44 user nova-compute[73450]:       <deviceboot/>
Aug 16 16:34:44 user nova-compute[73450]:       <disksnapshot default='on' toggle='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     </features>
Aug 16 16:34:44 user nova-compute[73450]:   </guest>
Aug 16 16:34:44 user nova-compute[73450]: </capabilities>
Aug 16 16:34:44 user nova-compute[73450]: 
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-i440fx-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>i686</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='255'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'/>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='lm'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ide</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-q35-jammy</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>i686</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='288'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'/>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='lm'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-q35-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>i686</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='288'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'/>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='lm'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-i440fx-jammy</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>i686</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='255'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'/>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='lm'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ide</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-i440fx-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>x86_64</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='255'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>efi</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='invtsc'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='rsba'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ide</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-q35-jammy</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>x86_64</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='288'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>efi</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='invtsc'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='rsba'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-q35-6.2</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>x86_64</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='288'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>efi</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='invtsc'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='rsba'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 16:34:44 user nova-compute[73450]: <domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 16:34:44 user nova-compute[73450]:   <domain>kvm</domain>
Aug 16 16:34:44 user nova-compute[73450]:   <machine>pc-i440fx-jammy</machine>
Aug 16 16:34:44 user nova-compute[73450]:   <arch>x86_64</arch>
Aug 16 16:34:44 user nova-compute[73450]:   <vcpu max='255'/>
Aug 16 16:34:44 user nova-compute[73450]:   <iothreads supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:   <os supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='firmware'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>efi</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:     <loader supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>rom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pflash</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='readonly'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>yes</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='secure'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>no</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </loader>
Aug 16 16:34:44 user nova-compute[73450]:   </os>
Aug 16 16:34:44 user nova-compute[73450]:   <cpu>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-passthrough' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='hostPassthroughMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='maximum' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='maximumMigratable'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>on</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>off</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='host-model' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <vendor>Intel</vendor>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ss'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='vmx'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pcid'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='hypervisor'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arat'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='umip'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='md-clear'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='invtsc'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibpb'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='ibrs'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-stibp'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='rsba'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='erms'/>
Aug 16 16:34:44 user nova-compute[73450]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:     <mode name='custom' supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>qemu64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>qemu32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>phenom</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>pentium</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>n270</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm64</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>kvm32</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>coreduo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>core2duo</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>athlon</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Westmere</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Snowridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Skylake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>SandyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Penryn</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G5</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G4</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G3</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Opteron_G2</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Opteron_G1</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>IvyBridge</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Icelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Haswell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Rome</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-Milan</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>EPYC</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Dhyana</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cooperlake</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>Conroe</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='no'>Broadwell</model>
Aug 16 16:34:44 user nova-compute[73450]:       <model usable='yes'>486</model>
Aug 16 16:34:44 user nova-compute[73450]:     </mode>
Aug 16 16:34:44 user nova-compute[73450]:   </cpu>
Aug 16 16:34:44 user nova-compute[73450]:   <memoryBacking supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:     <enum name='sourceType'>
Aug 16 16:34:44 user nova-compute[73450]:       <value>file</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>anonymous</value>
Aug 16 16:34:44 user nova-compute[73450]:       <value>memfd</value>
Aug 16 16:34:44 user nova-compute[73450]:     </enum>
Aug 16 16:34:44 user nova-compute[73450]:   </memoryBacking>
Aug 16 16:34:44 user nova-compute[73450]:   <devices>
Aug 16 16:34:44 user nova-compute[73450]:     <disk supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='diskDevice'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>disk</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cdrom</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>floppy</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>lun</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='bus'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ide</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>fdc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sata</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </disk>
Aug 16 16:34:44 user nova-compute[73450]:     <graphics supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='type'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>sdl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vnc</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>spice</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egl-headless</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </graphics>
Aug 16 16:34:44 user nova-compute[73450]:     <video supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='modelType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>cirrus</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>vmvga</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>qxl</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>none</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>bochs</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>ramfb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </video>
Aug 16 16:34:44 user nova-compute[73450]:     <hostdev supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='mode'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>subsystem</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='startupPolicy'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>default</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>mandatory</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>requisite</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>optional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='subsysType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>usb</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>pci</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>scsi</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='capsType'/>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='pciBackend'/>
Aug 16 16:34:44 user nova-compute[73450]:     </hostdev>
Aug 16 16:34:44 user nova-compute[73450]:     <rng supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtio-non-transitional</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>random</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>egd</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>builtin</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </rng>
Aug 16 16:34:44 user nova-compute[73450]:     <filesystem supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='driverType'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>path</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>handle</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>virtiofs</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </filesystem>
Aug 16 16:34:44 user nova-compute[73450]:     <tpm supported='yes'>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='model'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-tis</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>tpm-crb</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:       <enum name='backendModel'>
Aug 16 16:34:44 user nova-compute[73450]:         <value>passthrough</value>
Aug 16 16:34:44 user nova-compute[73450]:         <value>emulator</value>
Aug 16 16:34:44 user nova-compute[73450]:       </enum>
Aug 16 16:34:44 user nova-compute[73450]:     </tpm>
Aug 16 16:34:44 user nova-compute[73450]:   </devices>
Aug 16 16:34:44 user nova-compute[73450]:   <features>
Aug 16 16:34:44 user nova-compute[73450]:     <gic supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:     <vmcoreinfo supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <genid supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backingStoreInput supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <backup supported='yes'/>
Aug 16 16:34:44 user nova-compute[73450]:     <sev supported='no'/>
Aug 16 16:34:44 user nova-compute[73450]:   </features>
Aug 16 16:34:44 user nova-compute[73450]: </domainCapabilities>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73450) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73450) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Checking secure boot support for host arch (x86_64) {{(pid=73450) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Checking secure boot support for host arch (x86_64) {{(pid=73450) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Checking secure boot support for host arch (x86_64) {{(pid=73450) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 16:34:44 user nova-compute[73450]: INFO nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Secure Boot support detected
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] cpu compare xml: <cpu match="exact">
Aug 16 16:34:44 user nova-compute[73450]:   <model>Nehalem</model>
Aug 16 16:34:44 user nova-compute[73450]: </cpu>
Aug 16 16:34:44 user nova-compute[73450]:  {{(pid=73450) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 16:34:44 user nova-compute[73450]: INFO nova.virt.node [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Generated node identity 3f5625a5-ed70-4d17-8b42-ff2951fa276d
Aug 16 16:34:44 user nova-compute[73450]: INFO nova.virt.node [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Wrote node identity 3f5625a5-ed70-4d17-8b42-ff2951fa276d to /opt/stack/data/nova/compute_id
Aug 16 16:34:44 user nova-compute[73450]: WARNING nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Compute nodes ['3f5625a5-ed70-4d17-8b42-ff2951fa276d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 16:34:44 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 16:34:44 user nova-compute[73450]: WARNING nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 16:34:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:34:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:34:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:34:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Hypervisor/Node resource view: name=user free_ram=10842MB free_disk=25.020687103271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:34:45 user nova-compute[73450]: WARNING nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] No compute node record for user:3f5625a5-ed70-4d17-8b42-ff2951fa276d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3f5625a5-ed70-4d17-8b42-ff2951fa276d could not be found.
Aug 16 16:34:45 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Compute node record created for user:user with uuid: 3f5625a5-ed70-4d17-8b42-ff2951fa276d
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:34:45 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [req-d6418729-8fbb-441a-8b5f-da8f110985e2] Created resource provider record via placement API for resource provider with UUID 3f5625a5-ed70-4d17-8b42-ff2951fa276d and name user.
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73450) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 16:34:45 user nova-compute[73450]: INFO nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] kernel doesn't support AMD SEV
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Libvirt baseline CPU <cpu>
Aug 16 16:34:45 user nova-compute[73450]:   <arch>x86_64</arch>
Aug 16 16:34:45 user nova-compute[73450]:   <model>Nehalem</model>
Aug 16 16:34:45 user nova-compute[73450]:   <vendor>Intel</vendor>
Aug 16 16:34:45 user nova-compute[73450]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 16:34:45 user nova-compute[73450]: </cpu>
Aug 16 16:34:45 user nova-compute[73450]:  {{(pid=73450) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Updated inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Updating resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d generation from 0 to 1 during operation: update_inventory {{(pid=73450) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Updating resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d generation from 1 to 2 during operation: update_traits {{(pid=73450) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.service [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Creating RPC server for service compute {{(pid=73450) start /opt/stack/nova/nova/service.py:182}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.service [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Join ServiceGroup membership for this service compute {{(pid=73450) start /opt/stack/nova/nova/service.py:199}}
Aug 16 16:34:45 user nova-compute[73450]: DEBUG nova.servicegroup.drivers.db [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73450) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 16:35:30 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:30 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:35:35 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:35:35 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=10275MB free_disk=24.924415588378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:35:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:36:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:36:36 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:36:36 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=10194MB free_disk=24.971572875976562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:36:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:36:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:36:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:36:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:36:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:37:36 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:37:36 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=10198MB free_disk=24.75482177734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:37:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:37:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:37:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:37:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:37:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:38:37 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:38:37 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=9479MB free_disk=24.777645111083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:38:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:38:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:38:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:38:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:40 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:38:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "66f48511-dafc-457b-817e-5bfe039cefa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:38:45 user nova-compute[73450]: INFO nova.compute.claims [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Claim successful on node user
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:38:45 user nova-compute[73450]: INFO nova.compute.claims [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Claim successful on node user
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:38:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:38:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Creating image(s)
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "/opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "/opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "/opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:38:45 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:38:46 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:38:46 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Creating image(s)
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "/opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "/opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "/opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.policy [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b725deabeb954813950dc1841e6a09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ad8f16dae4525b9aecc767f42a261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.policy [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9979e5fda67540db87b360224958bdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edfc2caee59458eaf48af23248bfdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.part --force-share --output=json" returned: 0 in 0.210s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.virt.images [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] f5d06caa-7cbd-45eb-944b-5dc2a22ca419 was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:38:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.part /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.part /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.converted" returned: 0 in 0.462s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.717s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:47 user nova-compute[73450]: INFO oslo.privsep.daemon [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2yj17wky/privsep.sock']
Aug 16 16:38:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.170s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:47 user sudo[82762]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2yj17wky/privsep.sock
Aug 16 16:38:47 user sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 16:38:49 user sudo[82762]: pam_unix(sudo:session): session closed for user root
Aug 16 16:38:49 user nova-compute[73450]: INFO oslo.privsep.daemon [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Spawned new privsep daemon via rootwrap
Aug 16 16:38:49 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 16:38:49 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 16:38:49 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 16:38:49 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82768
Aug 16 16:38:49 user nova-compute[73450]: WARNING oslo_privsep.priv_context [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] privsep daemon already running
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.224s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.231s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk 1073741824" returned: 0 in 0.048s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.268s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Successfully created port: dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.231s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk 1073741824" returned: 0 in 0.063s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Cannot resize image /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.objects.instance [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lazy-loading 'migration_context' on Instance uuid 841c9d46-e3ce-4663-9ac0-2d3c1d56711f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Successfully created port: 12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Ensure instance console log exists: /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.252s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:38:50 user nova-compute[73450]: INFO nova.compute.claims [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Claim successful on node user
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Cannot resize image /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lazy-loading 'migration_context' on Instance uuid 66f48511-dafc-457b-817e-5bfe039cefa1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Ensure instance console log exists: /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:38:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:38:51 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:38:51 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Creating image(s)
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "/opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG nova.policy [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3275ae2aaad34aa8adb49e5de0dbe238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f813e9d59945b58a7f0141fb29ca46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.166s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk 1073741824" returned: 0 in 0.045s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Cannot resize image /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'migration_context' on Instance uuid 679cc7af-3bba-44b0-9d76-3f053f87dd80 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Ensure instance console log exists: /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:38:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:38:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Successfully created port: 2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:38:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Successfully updated port: dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:38:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:38:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquired lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:38:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Successfully updated port: 12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquired lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-changed-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Refreshing instance network info cache due to event network-changed-dce6432f-ad3b-4aaa-9c5b-928e87b9a711. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] Acquiring lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:38:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updating instance_info_cache with network_info: [{"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Releasing lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Instance network_info: |[{"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] Acquired lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Refreshing network info cache for port dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Start _get_guest_xml network_info=[{"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:38:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:38:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1548574365',display_name='tempest-ServersNegativeTestJSON-server-1548574365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1548574365',id=1,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78ad8f16dae4525b9aecc767f42a261',ramdisk_id='',reservation_id='r-ib7p5b01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651503421',owner_user_name='tempest-ServersNegativeTestJSON-1651503421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:38:46Z,user_data=None,user_id='b725deabeb954813950dc1841e6a09fc',uuid=66f48511-dafc-457b-817e-5bfe039cefa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converting VIF {"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lazy-loading 'pci_devices' on Instance uuid 66f48511-dafc-457b-817e-5bfe039cefa1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:38:56 user nova-compute[73450]:   <uuid>66f48511-dafc-457b-817e-5bfe039cefa1</uuid>
Aug 16 16:38:56 user nova-compute[73450]:   <name>instance-00000001</name>
Aug 16 16:38:56 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:38:56 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:38:56 user nova-compute[73450]:   <metadata>
Aug 16 16:38:56 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:38:56 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:38:56 user nova-compute[73450]:       <nova:name>tempest-ServersNegativeTestJSON-server-1548574365</nova:name>
Aug 16 16:38:56 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:38:56</nova:creationTime>
Aug 16 16:38:56 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:38:56 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:38:56 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:38:56 user nova-compute[73450]:       <nova:owner>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:user uuid="b725deabeb954813950dc1841e6a09fc">tempest-ServersNegativeTestJSON-1651503421-project-member</nova:user>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:project uuid="e78ad8f16dae4525b9aecc767f42a261">tempest-ServersNegativeTestJSON-1651503421</nova:project>
Aug 16 16:38:56 user nova-compute[73450]:       </nova:owner>
Aug 16 16:38:56 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:38:56 user nova-compute[73450]:       <nova:ports>
Aug 16 16:38:56 user nova-compute[73450]:         <nova:port uuid="dce6432f-ad3b-4aaa-9c5b-928e87b9a711">
Aug 16 16:38:56 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 16:38:56 user nova-compute[73450]:         </nova:port>
Aug 16 16:38:56 user nova-compute[73450]:       </nova:ports>
Aug 16 16:38:56 user nova-compute[73450]:     </nova:instance>
Aug 16 16:38:56 user nova-compute[73450]:   </metadata>
Aug 16 16:38:56 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:38:56 user nova-compute[73450]:     <system>
Aug 16 16:38:56 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:38:56 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:38:56 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:38:56 user nova-compute[73450]:       <entry name="serial">66f48511-dafc-457b-817e-5bfe039cefa1</entry>
Aug 16 16:38:56 user nova-compute[73450]:       <entry name="uuid">66f48511-dafc-457b-817e-5bfe039cefa1</entry>
Aug 16 16:38:56 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:38:56 user nova-compute[73450]:     </system>
Aug 16 16:38:56 user nova-compute[73450]:   </sysinfo>
Aug 16 16:38:56 user nova-compute[73450]:   <os>
Aug 16 16:38:56 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:38:56 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:38:56 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:38:56 user nova-compute[73450]:   </os>
Aug 16 16:38:56 user nova-compute[73450]:   <features>
Aug 16 16:38:56 user nova-compute[73450]:     <acpi/>
Aug 16 16:38:56 user nova-compute[73450]:     <apic/>
Aug 16 16:38:56 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:38:56 user nova-compute[73450]:   </features>
Aug 16 16:38:56 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:38:56 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:38:56 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:38:56 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:38:56 user nova-compute[73450]:   </clock>
Aug 16 16:38:56 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:38:56 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:38:56 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:38:56 user nova-compute[73450]:   </cpu>
Aug 16 16:38:56 user nova-compute[73450]:   <devices>
Aug 16 16:38:56 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:38:56 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:38:56 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk"/>
Aug 16 16:38:56 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:38:56 user nova-compute[73450]:     </disk>
Aug 16 16:38:56 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:38:56 user nova-compute[73450]:       <mac address="fa:16:3e:93:f5:37"/>
Aug 16 16:38:56 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:38:56 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:38:56 user nova-compute[73450]:       <target dev="tapdce6432f-ad"/>
Aug 16 16:38:56 user nova-compute[73450]:     </interface>
Aug 16 16:38:56 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:38:56 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/console.log" append="off"/>
Aug 16 16:38:56 user nova-compute[73450]:     </serial>
Aug 16 16:38:56 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:38:56 user nova-compute[73450]:     <video>
Aug 16 16:38:56 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:38:56 user nova-compute[73450]:     </video>
Aug 16 16:38:56 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:38:56 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:38:56 user nova-compute[73450]:     </rng>
Aug 16 16:38:56 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:38:56 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:38:56 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:38:56 user nova-compute[73450]:     </memballoon>
Aug 16 16:38:56 user nova-compute[73450]:   </devices>
Aug 16 16:38:56 user nova-compute[73450]: </domain>
Aug 16 16:38:56 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1548574365',display_name='tempest-ServersNegativeTestJSON-server-1548574365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1548574365',id=1,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78ad8f16dae4525b9aecc767f42a261',ramdisk_id='',reservation_id='r-ib7p5b01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651503421',owner_user_name='tempest-ServersNegativeTestJSON-1651503421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:38:46Z,user_data=None,user_id='b725deabeb954813950dc1841e6a09fc',uuid=66f48511-dafc-457b-817e-5bfe039cefa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converting VIF {"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG os_vif [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Created schema index Interface.name {{(pid=73450) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Created schema index Port.name {{(pid=73450) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Created schema index Bridge.name {{(pid=73450) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [POLLOUT] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:38:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:38:56 user nova-compute[73450]: INFO oslo.privsep.daemon [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpx4nw8qf5/privsep.sock']
Aug 16 16:38:56 user sudo[82848]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpx4nw8qf5/privsep.sock
Aug 16 16:38:56 user sudo[82848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updating instance_info_cache with network_info: [{"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Releasing lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Instance network_info: |[{"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Start _get_guest_xml network_info=[{"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:38:57 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:38:57 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1936032143',display_name='tempest-DeleteServersTestJSON-server-1936032143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1936032143',id=2,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7edfc2caee59458eaf48af23248bfdc1',ramdisk_id='',reservation_id='r-5cf7el7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-759361170',owner_user_name='tempest-DeleteServersTestJSON-759361170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:38:46Z,user_data=None,user_id='9979e5fda67540db87b360224958bdb9',uuid=841c9d46-e3ce-4663-9ac0-2d3c1d56711f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Converting VIF {"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.objects.instance [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lazy-loading 'pci_devices' on Instance uuid 841c9d46-e3ce-4663-9ac0-2d3c1d56711f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:38:57 user nova-compute[73450]:   <uuid>841c9d46-e3ce-4663-9ac0-2d3c1d56711f</uuid>
Aug 16 16:38:57 user nova-compute[73450]:   <name>instance-00000002</name>
Aug 16 16:38:57 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:38:57 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:38:57 user nova-compute[73450]:   <metadata>
Aug 16 16:38:57 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:38:57 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:38:57 user nova-compute[73450]:       <nova:name>tempest-DeleteServersTestJSON-server-1936032143</nova:name>
Aug 16 16:38:57 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:38:57</nova:creationTime>
Aug 16 16:38:57 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:38:57 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:38:57 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:38:57 user nova-compute[73450]:       <nova:owner>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:user uuid="9979e5fda67540db87b360224958bdb9">tempest-DeleteServersTestJSON-759361170-project-member</nova:user>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:project uuid="7edfc2caee59458eaf48af23248bfdc1">tempest-DeleteServersTestJSON-759361170</nova:project>
Aug 16 16:38:57 user nova-compute[73450]:       </nova:owner>
Aug 16 16:38:57 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:38:57 user nova-compute[73450]:       <nova:ports>
Aug 16 16:38:57 user nova-compute[73450]:         <nova:port uuid="12ad8621-0f8e-43d2-8fa8-87aa589ac9cb">
Aug 16 16:38:57 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 16:38:57 user nova-compute[73450]:         </nova:port>
Aug 16 16:38:57 user nova-compute[73450]:       </nova:ports>
Aug 16 16:38:57 user nova-compute[73450]:     </nova:instance>
Aug 16 16:38:57 user nova-compute[73450]:   </metadata>
Aug 16 16:38:57 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:38:57 user nova-compute[73450]:     <system>
Aug 16 16:38:57 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:38:57 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:38:57 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:38:57 user nova-compute[73450]:       <entry name="serial">841c9d46-e3ce-4663-9ac0-2d3c1d56711f</entry>
Aug 16 16:38:57 user nova-compute[73450]:       <entry name="uuid">841c9d46-e3ce-4663-9ac0-2d3c1d56711f</entry>
Aug 16 16:38:57 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:38:57 user nova-compute[73450]:     </system>
Aug 16 16:38:57 user nova-compute[73450]:   </sysinfo>
Aug 16 16:38:57 user nova-compute[73450]:   <os>
Aug 16 16:38:57 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:38:57 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:38:57 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:38:57 user nova-compute[73450]:   </os>
Aug 16 16:38:57 user nova-compute[73450]:   <features>
Aug 16 16:38:57 user nova-compute[73450]:     <acpi/>
Aug 16 16:38:57 user nova-compute[73450]:     <apic/>
Aug 16 16:38:57 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:38:57 user nova-compute[73450]:   </features>
Aug 16 16:38:57 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:38:57 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:38:57 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:38:57 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:38:57 user nova-compute[73450]:   </clock>
Aug 16 16:38:57 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:38:57 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:38:57 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:38:57 user nova-compute[73450]:   </cpu>
Aug 16 16:38:57 user nova-compute[73450]:   <devices>
Aug 16 16:38:57 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:38:57 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:38:57 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk"/>
Aug 16 16:38:57 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:38:57 user nova-compute[73450]:     </disk>
Aug 16 16:38:57 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:38:57 user nova-compute[73450]:       <mac address="fa:16:3e:84:b7:80"/>
Aug 16 16:38:57 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:38:57 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:38:57 user nova-compute[73450]:       <target dev="tap12ad8621-0f"/>
Aug 16 16:38:57 user nova-compute[73450]:     </interface>
Aug 16 16:38:57 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:38:57 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/console.log" append="off"/>
Aug 16 16:38:57 user nova-compute[73450]:     </serial>
Aug 16 16:38:57 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:38:57 user nova-compute[73450]:     <video>
Aug 16 16:38:57 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:38:57 user nova-compute[73450]:     </video>
Aug 16 16:38:57 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:38:57 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:38:57 user nova-compute[73450]:     </rng>
Aug 16 16:38:57 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:38:57 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:38:57 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:38:57 user nova-compute[73450]:     </memballoon>
Aug 16 16:38:57 user nova-compute[73450]:   </devices>
Aug 16 16:38:57 user nova-compute[73450]: </domain>
Aug 16 16:38:57 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1936032143',display_name='tempest-DeleteServersTestJSON-server-1936032143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1936032143',id=2,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7edfc2caee59458eaf48af23248bfdc1',ramdisk_id='',reservation_id='r-5cf7el7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-759361170',owner_user_name='tempest-DeleteServersTestJSON-759361170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:38:46Z,user_data=None,user_id='9979e5fda67540db87b360224958bdb9',uuid=841c9d46-e3ce-4663-9ac0-2d3c1d56711f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Converting VIF {"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG os_vif [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-changed-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Refreshing instance network info cache due to event network-changed-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] Acquiring lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] Acquired lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:38:57 user nova-compute[73450]: DEBUG nova.network.neutron [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Refreshing network info cache for port 12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:38:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:58 user sudo[82848]: pam_unix(sudo:session): session closed for user root
Aug 16 16:38:58 user nova-compute[73450]: INFO oslo.privsep.daemon [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Spawned new privsep daemon via rootwrap
Aug 16 16:38:58 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 16:38:58 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 16:38:58 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 16:38:58 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82854
Aug 16 16:38:58 user nova-compute[73450]: WARNING oslo_privsep.priv_context [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] privsep daemon already running
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updated VIF entry in instance network info cache for port dce6432f-ad3b-4aaa-9c5b-928e87b9a711. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updating instance_info_cache with network_info: [{"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-725be1a1-b0b7-490a-ad9e-853715502084 req-78189262-8a23-42d7-ace1-743b142fc6ca service nova] Releasing lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12ad8621-0f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12ad8621-0f, col_values=(('external_ids', {'iface-id': '12ad8621-0f8e-43d2-8fa8-87aa589ac9cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:b7:80', 'vm-uuid': '841c9d46-e3ce-4663-9ac0-2d3c1d56711f'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Successfully updated port: 2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: INFO os_vif [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f')
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdce6432f-ad, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdce6432f-ad, col_values=(('external_ids', {'iface-id': 'dce6432f-ad3b-4aaa-9c5b-928e87b9a711', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f5:37', 'vm-uuid': '66f48511-dafc-457b-817e-5bfe039cefa1'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: INFO os_vif [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad')
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updated VIF entry in instance network info cache for port 12ad8621-0f8e-43d2-8fa8-87aa589ac9cb. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updating instance_info_cache with network_info: [{"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] No VIF found with MAC fa:16:3e:84:b7:80, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] No VIF found with MAC fa:16:3e:93:f5:37, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dc3e4aac-ced4-48a7-876b-358d9726e37f req-3e134d1b-3074-4542-af1f-1c7da5a29b71 service nova] Releasing lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-changed-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Refreshing instance network info cache due to event network-changed-2c28ddf3-dbf0-484c-835e-99eb614a6238. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:38:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] Acquiring lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updating instance_info_cache with network_info: [{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Instance network_info: |[{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] Acquired lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Refreshing network info cache for port 2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Start _get_guest_xml network_info=[{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:39:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1266330888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1266330888',id=3,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-bqq98cgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:38:51Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=679cc7af-3bba-44b0-9d76-3f053f87dd80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'pci_devices' on Instance uuid 679cc7af-3bba-44b0-9d76-3f053f87dd80 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:39:00 user nova-compute[73450]:   <uuid>679cc7af-3bba-44b0-9d76-3f053f87dd80</uuid>
Aug 16 16:39:00 user nova-compute[73450]:   <name>instance-00000003</name>
Aug 16 16:39:00 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:39:00 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:39:00 user nova-compute[73450]:   <metadata>
Aug 16 16:39:00 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:39:00 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:39:00 user nova-compute[73450]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1266330888</nova:name>
Aug 16 16:39:00 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:39:00</nova:creationTime>
Aug 16 16:39:00 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:39:00 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:39:00 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:39:00 user nova-compute[73450]:       <nova:owner>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:user uuid="3275ae2aaad34aa8adb49e5de0dbe238">tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member</nova:user>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:project uuid="88f813e9d59945b58a7f0141fb29ca46">tempest-ServerBootFromVolumeStableRescueTest-311543227</nova:project>
Aug 16 16:39:00 user nova-compute[73450]:       </nova:owner>
Aug 16 16:39:00 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:39:00 user nova-compute[73450]:       <nova:ports>
Aug 16 16:39:00 user nova-compute[73450]:         <nova:port uuid="2c28ddf3-dbf0-484c-835e-99eb614a6238">
Aug 16 16:39:00 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 16:39:00 user nova-compute[73450]:         </nova:port>
Aug 16 16:39:00 user nova-compute[73450]:       </nova:ports>
Aug 16 16:39:00 user nova-compute[73450]:     </nova:instance>
Aug 16 16:39:00 user nova-compute[73450]:   </metadata>
Aug 16 16:39:00 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:39:00 user nova-compute[73450]:     <system>
Aug 16 16:39:00 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:39:00 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:39:00 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:39:00 user nova-compute[73450]:       <entry name="serial">679cc7af-3bba-44b0-9d76-3f053f87dd80</entry>
Aug 16 16:39:00 user nova-compute[73450]:       <entry name="uuid">679cc7af-3bba-44b0-9d76-3f053f87dd80</entry>
Aug 16 16:39:00 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:39:00 user nova-compute[73450]:     </system>
Aug 16 16:39:00 user nova-compute[73450]:   </sysinfo>
Aug 16 16:39:00 user nova-compute[73450]:   <os>
Aug 16 16:39:00 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:39:00 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:39:00 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:39:00 user nova-compute[73450]:   </os>
Aug 16 16:39:00 user nova-compute[73450]:   <features>
Aug 16 16:39:00 user nova-compute[73450]:     <acpi/>
Aug 16 16:39:00 user nova-compute[73450]:     <apic/>
Aug 16 16:39:00 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:39:00 user nova-compute[73450]:   </features>
Aug 16 16:39:00 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:39:00 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:39:00 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:39:00 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:39:00 user nova-compute[73450]:   </clock>
Aug 16 16:39:00 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:39:00 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:39:00 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:39:00 user nova-compute[73450]:   </cpu>
Aug 16 16:39:00 user nova-compute[73450]:   <devices>
Aug 16 16:39:00 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:39:00 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:39:00 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk"/>
Aug 16 16:39:00 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:39:00 user nova-compute[73450]:     </disk>
Aug 16 16:39:00 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:39:00 user nova-compute[73450]:       <mac address="fa:16:3e:f1:78:90"/>
Aug 16 16:39:00 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:00 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:39:00 user nova-compute[73450]:       <target dev="tap2c28ddf3-db"/>
Aug 16 16:39:00 user nova-compute[73450]:     </interface>
Aug 16 16:39:00 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:39:00 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/console.log" append="off"/>
Aug 16 16:39:00 user nova-compute[73450]:     </serial>
Aug 16 16:39:00 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:39:00 user nova-compute[73450]:     <video>
Aug 16 16:39:00 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:00 user nova-compute[73450]:     </video>
Aug 16 16:39:00 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:39:00 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:39:00 user nova-compute[73450]:     </rng>
Aug 16 16:39:00 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:39:00 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:39:00 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:39:00 user nova-compute[73450]:     </memballoon>
Aug 16 16:39:00 user nova-compute[73450]:   </devices>
Aug 16 16:39:00 user nova-compute[73450]: </domain>
Aug 16 16:39:00 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1266330888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1266330888',id=3,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-bqq98cgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:38:51Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=679cc7af-3bba-44b0-9d76-3f053f87dd80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG os_vif [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c28ddf3-db, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c28ddf3-db, col_values=(('external_ids', {'iface-id': '2c28ddf3-dbf0-484c-835e-99eb614a6238', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:78:90', 'vm-uuid': '679cc7af-3bba-44b0-9d76-3f053f87dd80'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:00 user nova-compute[73450]: INFO os_vif [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db')
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No VIF found with MAC fa:16:3e:f1:78:90, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:39:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:01 user nova-compute[73450]: DEBUG nova.network.neutron [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updated VIF entry in instance network info cache for port 2c28ddf3-dbf0-484c-835e-99eb614a6238. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:39:01 user nova-compute[73450]: DEBUG nova.network.neutron [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updating instance_info_cache with network_info: [{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba802db0-3d01-45b1-9c8c-697547f34158 req-c11bf411-29cb-4235-82fa-0b9473b41f2c service nova] Releasing lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203945.667615, 66f48511-dafc-457b-817e-5bfe039cefa1 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] VM Resumed (Lifecycle Event)
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Instance spawned successfully.
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Instance spawned successfully.
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203945.667818, 66f48511-dafc-457b-817e-5bfe039cefa1 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] VM Started (Lifecycle Event)
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Instance spawned successfully.
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:05 user nova-compute[73450]: INFO nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Took 20.00 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203945.7984672, 841c9d46-e3ce-4663-9ac0-2d3c1d56711f => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] VM Resumed (Lifecycle Event)
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Took 19.64 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Took 21.24 seconds to build instance.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b905e056-17dd-450b-bbf0-c65469637391 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "66f48511-dafc-457b-817e-5bfe039cefa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.505s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Took 20.80 seconds to build instance.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-677ba7b0-f689-4948-a855-2c316e3d10a1 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.993s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203945.7998068, 841c9d46-e3ce-4663-9ac0-2d3c1d56711f => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] VM Started (Lifecycle Event)
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Took 14.79 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203945.8611917, 679cc7af-3bba-44b0-9d76-3f053f87dd80 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] VM Resumed (Lifecycle Event)
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203945.8673594, 679cc7af-3bba-44b0-9d76-3f053f87dd80 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] VM Started (Lifecycle Event)
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:06 user nova-compute[73450]: INFO nova.compute.manager [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Took 15.70 seconds to build instance.
Aug 16 16:39:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b60d8f1e-4eab-4076-b2c8-94753bd4f2c5 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.826s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-b9155b9a-634a-48cd-8976-6da1e3879274 req-dc452b4e-7eb5-407a-b106-9bec784fec07 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b9155b9a-634a-48cd-8976-6da1e3879274 req-dc452b4e-7eb5-407a-b106-9bec784fec07 service nova] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b9155b9a-634a-48cd-8976-6da1e3879274 req-dc452b4e-7eb5-407a-b106-9bec784fec07 service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b9155b9a-634a-48cd-8976-6da1e3879274 req-dc452b4e-7eb5-407a-b106-9bec784fec07 service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-b9155b9a-634a-48cd-8976-6da1e3879274 req-dc452b4e-7eb5-407a-b106-9bec784fec07 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] No waiting events found dispatching network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:07 user nova-compute[73450]: WARNING nova.compute.manager [req-b9155b9a-634a-48cd-8976-6da1e3879274 req-dc452b4e-7eb5-407a-b106-9bec784fec07 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received unexpected event network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 for instance with vm_state active and task_state None.
Aug 16 16:39:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:39:09 user nova-compute[73450]: INFO nova.compute.claims [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Claim successful on node user
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] No waiting events found dispatching network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:09 user nova-compute[73450]: WARNING nova.compute.manager [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received unexpected event network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 for instance with vm_state active and task_state None.
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] No waiting events found dispatching network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:09 user nova-compute[73450]: WARNING nova.compute.manager [req-70146beb-7d1a-4079-bd83-16311ca8f014 req-b57b58d6-4fc1-43c3-8913-0fc91b6186bd service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received unexpected event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 for instance with vm_state active and task_state None.
Aug 16 16:39:09 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.network.neutron [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:39:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:39:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Creating image(s)
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "/opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "/opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "/opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG nova.policy [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b666e97bbda244efacbb351870c8bb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8273d8b0ea47daad0ea34b03caa47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.230s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.297s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk 1073741824" returned: 0 in 0.098s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.259s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Cannot resize image /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lazy-loading 'migration_context' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Ensure instance console log exists: /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-6fea0604-eda0-4736-b7f9-6fff8f33ab61 req-7d5fe76b-caf5-413c-8096-184e0e04897f service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6fea0604-eda0-4736-b7f9-6fff8f33ab61 req-7d5fe76b-caf5-413c-8096-184e0e04897f service nova] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6fea0604-eda0-4736-b7f9-6fff8f33ab61 req-7d5fe76b-caf5-413c-8096-184e0e04897f service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6fea0604-eda0-4736-b7f9-6fff8f33ab61 req-7d5fe76b-caf5-413c-8096-184e0e04897f service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-6fea0604-eda0-4736-b7f9-6fff8f33ab61 req-7d5fe76b-caf5-413c-8096-184e0e04897f service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] No waiting events found dispatching network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:12 user nova-compute[73450]: WARNING nova.compute.manager [req-6fea0604-eda0-4736-b7f9-6fff8f33ab61 req-7d5fe76b-caf5-413c-8096-184e0e04897f service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received unexpected event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 for instance with vm_state active and task_state None.
Aug 16 16:39:12 user nova-compute[73450]: DEBUG nova.network.neutron [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Successfully created port: 69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:39:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:39:15 user nova-compute[73450]: INFO nova.compute.claims [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Claim successful on node user
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Successfully updated port: 69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquired lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-changed-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Refreshing instance network info cache due to event network-changed-69fbeea4-4203-4f15-85a8-5be48915e06d. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] Acquiring lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:39:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.policy [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb9ce31454384235b35cb8dd1e257364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7478d576cef940d38c222b5e2de1b8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:39:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Creating image(s)
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "/opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "/opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "/opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updating instance_info_cache with network_info: [{"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Releasing lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Instance network_info: |[{"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] Acquired lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.network.neutron [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Refreshing network info cache for port 69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Start _get_guest_xml network_info=[{"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:39:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-278790643',display_name='tempest-VolumesAssistedSnapshotsTest-server-278790643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-278790643',id=4,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKM+fEuBOjDPnznKqDlYMJeytvqSYxUVuJnfYfyrKM6Olkhj8pEptwdOsQGDevZnY1aqF1gsg04q0jLUzIuHBZmvdwPCbaDYlHn9AqyhwR7Sf/oIvoIopzhMMatf5DzblA==',key_name='tempest-keypair-1040848914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8273d8b0ea47daad0ea34b03caa47d',ramdisk_id='',reservation_id='r-3qgajwwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-767903908',owner_user_name='tempest-VolumesAssistedSnapshotsTest-767903908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666e97bbda244efacbb351870c8bb30',uuid=816ac70d-0ed7-4bf0-ae30-f265f7889221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Converting VIF {"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lazy-loading 'pci_devices' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:39:16 user nova-compute[73450]:   <uuid>816ac70d-0ed7-4bf0-ae30-f265f7889221</uuid>
Aug 16 16:39:16 user nova-compute[73450]:   <name>instance-00000004</name>
Aug 16 16:39:16 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:39:16 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:39:16 user nova-compute[73450]:   <metadata>
Aug 16 16:39:16 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:39:16 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:39:16 user nova-compute[73450]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-278790643</nova:name>
Aug 16 16:39:16 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:39:16</nova:creationTime>
Aug 16 16:39:16 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:39:16 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:39:16 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:39:16 user nova-compute[73450]:       <nova:owner>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:user uuid="b666e97bbda244efacbb351870c8bb30">tempest-VolumesAssistedSnapshotsTest-767903908-project-member</nova:user>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:project uuid="4e8273d8b0ea47daad0ea34b03caa47d">tempest-VolumesAssistedSnapshotsTest-767903908</nova:project>
Aug 16 16:39:16 user nova-compute[73450]:       </nova:owner>
Aug 16 16:39:16 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:39:16 user nova-compute[73450]:       <nova:ports>
Aug 16 16:39:16 user nova-compute[73450]:         <nova:port uuid="69fbeea4-4203-4f15-85a8-5be48915e06d">
Aug 16 16:39:16 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 16:39:16 user nova-compute[73450]:         </nova:port>
Aug 16 16:39:16 user nova-compute[73450]:       </nova:ports>
Aug 16 16:39:16 user nova-compute[73450]:     </nova:instance>
Aug 16 16:39:16 user nova-compute[73450]:   </metadata>
Aug 16 16:39:16 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:39:16 user nova-compute[73450]:     <system>
Aug 16 16:39:16 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:39:16 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:39:16 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:39:16 user nova-compute[73450]:       <entry name="serial">816ac70d-0ed7-4bf0-ae30-f265f7889221</entry>
Aug 16 16:39:16 user nova-compute[73450]:       <entry name="uuid">816ac70d-0ed7-4bf0-ae30-f265f7889221</entry>
Aug 16 16:39:16 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:39:16 user nova-compute[73450]:     </system>
Aug 16 16:39:16 user nova-compute[73450]:   </sysinfo>
Aug 16 16:39:16 user nova-compute[73450]:   <os>
Aug 16 16:39:16 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:39:16 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:39:16 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:39:16 user nova-compute[73450]:   </os>
Aug 16 16:39:16 user nova-compute[73450]:   <features>
Aug 16 16:39:16 user nova-compute[73450]:     <acpi/>
Aug 16 16:39:16 user nova-compute[73450]:     <apic/>
Aug 16 16:39:16 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:39:16 user nova-compute[73450]:   </features>
Aug 16 16:39:16 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:39:16 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:39:16 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:39:16 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:39:16 user nova-compute[73450]:   </clock>
Aug 16 16:39:16 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:39:16 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:39:16 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:39:16 user nova-compute[73450]:   </cpu>
Aug 16 16:39:16 user nova-compute[73450]:   <devices>
Aug 16 16:39:16 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:39:16 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:39:16 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk"/>
Aug 16 16:39:16 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:39:16 user nova-compute[73450]:     </disk>
Aug 16 16:39:16 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:39:16 user nova-compute[73450]:       <mac address="fa:16:3e:0c:87:78"/>
Aug 16 16:39:16 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:16 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:39:16 user nova-compute[73450]:       <target dev="tap69fbeea4-42"/>
Aug 16 16:39:16 user nova-compute[73450]:     </interface>
Aug 16 16:39:16 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:39:16 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/console.log" append="off"/>
Aug 16 16:39:16 user nova-compute[73450]:     </serial>
Aug 16 16:39:16 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:39:16 user nova-compute[73450]:     <video>
Aug 16 16:39:16 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:16 user nova-compute[73450]:     </video>
Aug 16 16:39:16 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:39:16 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:39:16 user nova-compute[73450]:     </rng>
Aug 16 16:39:16 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:39:16 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:39:16 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:39:16 user nova-compute[73450]:     </memballoon>
Aug 16 16:39:16 user nova-compute[73450]:   </devices>
Aug 16 16:39:16 user nova-compute[73450]: </domain>
Aug 16 16:39:16 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-278790643',display_name='tempest-VolumesAssistedSnapshotsTest-server-278790643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-278790643',id=4,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKM+fEuBOjDPnznKqDlYMJeytvqSYxUVuJnfYfyrKM6Olkhj8pEptwdOsQGDevZnY1aqF1gsg04q0jLUzIuHBZmvdwPCbaDYlHn9AqyhwR7Sf/oIvoIopzhMMatf5DzblA==',key_name='tempest-keypair-1040848914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8273d8b0ea47daad0ea34b03caa47d',ramdisk_id='',reservation_id='r-3qgajwwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-767903908',owner_user_name='tempest-VolumesAssistedSnapshotsTest-767903908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666e97bbda244efacbb351870c8bb30',uuid=816ac70d-0ed7-4bf0-ae30-f265f7889221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Converting VIF {"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG os_vif [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69fbeea4-42, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69fbeea4-42, col_values=(('external_ids', {'iface-id': '69fbeea4-4203-4f15-85a8-5be48915e06d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:87:78', 'vm-uuid': '816ac70d-0ed7-4bf0-ae30-f265f7889221'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:16 user nova-compute[73450]: INFO os_vif [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42')
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.273s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] No VIF found with MAC fa:16:3e:0c:87:78, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.221s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk 1073741824" returned: 0 in 0.075s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.274s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:39:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Cannot resize image /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'migration_context' on Instance uuid 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.network.neutron [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updated VIF entry in instance network info cache for port 69fbeea4-4203-4f15-85a8-5be48915e06d. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.network.neutron [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updating instance_info_cache with network_info: [{"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.network.neutron [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Successfully created port: 10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Ensure instance console log exists: /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cdcb69e1-4ce7-4569-879e-dabcb8ebe36c req-a7c9b8cd-0fbb-4da4-8e28-f78d49211a30 service nova] Releasing lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Successfully updated port: 10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-changed-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Refreshing instance network info cache due to event network-changed-10450674-e9c9-447e-b1ab-d53f226dae29. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] Acquiring lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] Acquired lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Refreshing network info cache for port 10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-13829dec-b64f-49c4-b8cb-5241903cac38 req-92f8fb4a-5bae-4a64-9144-bb1b210ad9b5 service nova] Releasing lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquired lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:39:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating instance_info_cache with network_info: [{"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Releasing lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Instance network_info: |[{"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Start _get_guest_xml network_info=[{"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:39:20 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:20 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1853776870',display_name='tempest-VolumesAdminNegativeTest-server-1853776870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1853776870',id=5,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4JHGAuQToGh3bh4Wmz4D5WtinAtOYht83bCTrlYP6XyUemCjGwhxUSz2GrDqiC/XVv6afOawoCvVHCC5bF7Q73NMK7eeRsSiQxkflM96ENYFcIbuzjaFp7YnMRYe0fgQ==',key_name='tempest-keypair-603146943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7478d576cef940d38c222b5e2de1b8f0',ramdisk_id='',reservation_id='r-bmdhat5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1290942672',owner_user_name='tempest-VolumesAdminNegativeTest-1290942672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9ce31454384235b35cb8dd1e257364',uuid=42484cde-66d6-4816-962b-912f6df59156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converting VIF {"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.objects.instance [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'pci_devices' on Instance uuid 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:39:20 user nova-compute[73450]:   <uuid>42484cde-66d6-4816-962b-912f6df59156</uuid>
Aug 16 16:39:20 user nova-compute[73450]:   <name>instance-00000005</name>
Aug 16 16:39:20 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:39:20 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:39:20 user nova-compute[73450]:   <metadata>
Aug 16 16:39:20 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:39:20 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:39:20 user nova-compute[73450]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1853776870</nova:name>
Aug 16 16:39:20 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:39:20</nova:creationTime>
Aug 16 16:39:20 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:39:20 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:39:20 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:39:20 user nova-compute[73450]:       <nova:owner>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:user uuid="bb9ce31454384235b35cb8dd1e257364">tempest-VolumesAdminNegativeTest-1290942672-project-member</nova:user>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:project uuid="7478d576cef940d38c222b5e2de1b8f0">tempest-VolumesAdminNegativeTest-1290942672</nova:project>
Aug 16 16:39:20 user nova-compute[73450]:       </nova:owner>
Aug 16 16:39:20 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:39:20 user nova-compute[73450]:       <nova:ports>
Aug 16 16:39:20 user nova-compute[73450]:         <nova:port uuid="10450674-e9c9-447e-b1ab-d53f226dae29">
Aug 16 16:39:20 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 16:39:20 user nova-compute[73450]:         </nova:port>
Aug 16 16:39:20 user nova-compute[73450]:       </nova:ports>
Aug 16 16:39:20 user nova-compute[73450]:     </nova:instance>
Aug 16 16:39:20 user nova-compute[73450]:   </metadata>
Aug 16 16:39:20 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:39:20 user nova-compute[73450]:     <system>
Aug 16 16:39:20 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:39:20 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:39:20 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:39:20 user nova-compute[73450]:       <entry name="serial">42484cde-66d6-4816-962b-912f6df59156</entry>
Aug 16 16:39:20 user nova-compute[73450]:       <entry name="uuid">42484cde-66d6-4816-962b-912f6df59156</entry>
Aug 16 16:39:20 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:39:20 user nova-compute[73450]:     </system>
Aug 16 16:39:20 user nova-compute[73450]:   </sysinfo>
Aug 16 16:39:20 user nova-compute[73450]:   <os>
Aug 16 16:39:20 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:39:20 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:39:20 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:39:20 user nova-compute[73450]:   </os>
Aug 16 16:39:20 user nova-compute[73450]:   <features>
Aug 16 16:39:20 user nova-compute[73450]:     <acpi/>
Aug 16 16:39:20 user nova-compute[73450]:     <apic/>
Aug 16 16:39:20 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:39:20 user nova-compute[73450]:   </features>
Aug 16 16:39:20 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:39:20 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:39:20 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:39:20 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:39:20 user nova-compute[73450]:   </clock>
Aug 16 16:39:20 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:39:20 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:39:20 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:39:20 user nova-compute[73450]:   </cpu>
Aug 16 16:39:20 user nova-compute[73450]:   <devices>
Aug 16 16:39:20 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:39:20 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:39:20 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk"/>
Aug 16 16:39:20 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:39:20 user nova-compute[73450]:     </disk>
Aug 16 16:39:20 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:39:20 user nova-compute[73450]:       <mac address="fa:16:3e:4f:5b:3a"/>
Aug 16 16:39:20 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:20 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:39:20 user nova-compute[73450]:       <target dev="tap10450674-e9"/>
Aug 16 16:39:20 user nova-compute[73450]:     </interface>
Aug 16 16:39:20 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:39:20 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/console.log" append="off"/>
Aug 16 16:39:20 user nova-compute[73450]:     </serial>
Aug 16 16:39:20 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:39:20 user nova-compute[73450]:     <video>
Aug 16 16:39:20 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:20 user nova-compute[73450]:     </video>
Aug 16 16:39:20 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:39:20 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:39:20 user nova-compute[73450]:     </rng>
Aug 16 16:39:20 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:39:20 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:39:20 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:39:20 user nova-compute[73450]:     </memballoon>
Aug 16 16:39:20 user nova-compute[73450]:   </devices>
Aug 16 16:39:20 user nova-compute[73450]: </domain>
Aug 16 16:39:20 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1853776870',display_name='tempest-VolumesAdminNegativeTest-server-1853776870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1853776870',id=5,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4JHGAuQToGh3bh4Wmz4D5WtinAtOYht83bCTrlYP6XyUemCjGwhxUSz2GrDqiC/XVv6afOawoCvVHCC5bF7Q73NMK7eeRsSiQxkflM96ENYFcIbuzjaFp7YnMRYe0fgQ==',key_name='tempest-keypair-603146943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7478d576cef940d38c222b5e2de1b8f0',ramdisk_id='',reservation_id='r-bmdhat5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1290942672',owner_user_name='tempest-VolumesAdminNegativeTest-1290942672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9ce31454384235b35cb8dd1e257364',uuid=42484cde-66d6-4816-962b-912f6df59156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converting VIF {"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG os_vif [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10450674-e9, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10450674-e9, col_values=(('external_ids', {'iface-id': '10450674-e9c9-447e-b1ab-d53f226dae29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:5b:3a', 'vm-uuid': '42484cde-66d6-4816-962b-912f6df59156'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:20 user nova-compute[73450]: INFO os_vif [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9')
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No VIF found with MAC fa:16:3e:4f:5b:3a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203961.0462012, 816ac70d-0ed7-4bf0-ae30-f265f7889221 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] VM Resumed (Lifecycle Event)
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Instance spawned successfully.
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203961.0474916, 816ac70d-0ed7-4bf0-ae30-f265f7889221 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] VM Started (Lifecycle Event)
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Took 10.75 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:21 user nova-compute[73450]: INFO nova.compute.manager [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Took 12.30 seconds to build instance.
Aug 16 16:39:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-758c69eb-d345-4ca2-83d2-a2663cc03203 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.721s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:39:23 user nova-compute[73450]: INFO nova.compute.claims [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Claim successful on node user
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-db766d96-8648-46a4-be5c-7420278a1161 req-2257f9bd-3861-41ae-a0c2-ce1b28619b89 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-db766d96-8648-46a4-be5c-7420278a1161 req-2257f9bd-3861-41ae-a0c2-ce1b28619b89 service nova] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-db766d96-8648-46a4-be5c-7420278a1161 req-2257f9bd-3861-41ae-a0c2-ce1b28619b89 service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-db766d96-8648-46a4-be5c-7420278a1161 req-2257f9bd-3861-41ae-a0c2-ce1b28619b89 service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-db766d96-8648-46a4-be5c-7420278a1161 req-2257f9bd-3861-41ae-a0c2-ce1b28619b89 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] No waiting events found dispatching network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:23 user nova-compute[73450]: WARNING nova.compute.manager [req-db766d96-8648-46a4-be5c-7420278a1161 req-2257f9bd-3861-41ae-a0c2-ce1b28619b89 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received unexpected event network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb for instance with vm_state active and task_state None.
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:39:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:39:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG nova.policy [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3239db433fd64ee698d8c47071b12016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c54782056d4249a0e5bb9bae2d35f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:39:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Creating image(s)
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "/opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "/opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.268s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk 1073741824" returned: 0 in 0.067s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203965.1895897, 42484cde-66d6-4816-962b-912f6df59156 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] VM Resumed (Lifecycle Event)
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] Instance spawned successfully.
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Successfully created port: ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203965.193976, 42484cde-66d6-4816-962b-912f6df59156 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] VM Started (Lifecycle Event)
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Cannot resize image /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lazy-loading 'migration_context' on Instance uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Ensure instance console log exists: /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Took 9.48 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:25 user nova-compute[73450]: INFO nova.compute.manager [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Took 10.56 seconds to build instance.
Aug 16 16:39:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4ecb7fa6-0088-4554-9fc9-a28d3fc85d9d tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.800s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c7020fb-9588-4800-bff0-c1c93d845fda req-feb5a6f9-1f8c-40fe-8aba-fb3704f2b99e service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c7020fb-9588-4800-bff0-c1c93d845fda req-feb5a6f9-1f8c-40fe-8aba-fb3704f2b99e service nova] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c7020fb-9588-4800-bff0-c1c93d845fda req-feb5a6f9-1f8c-40fe-8aba-fb3704f2b99e service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c7020fb-9588-4800-bff0-c1c93d845fda req-feb5a6f9-1f8c-40fe-8aba-fb3704f2b99e service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c7020fb-9588-4800-bff0-c1c93d845fda req-feb5a6f9-1f8c-40fe-8aba-fb3704f2b99e service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] No waiting events found dispatching network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:25 user nova-compute[73450]: WARNING nova.compute.manager [req-6c7020fb-9588-4800-bff0-c1c93d845fda req-feb5a6f9-1f8c-40fe-8aba-fb3704f2b99e service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received unexpected event network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb for instance with vm_state active and task_state None.
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Successfully updated port: ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquired lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-changed-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Refreshing instance network info cache due to event network-changed-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] Acquiring lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:39:26 user nova-compute[73450]: INFO nova.compute.claims [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Claim successful on node user
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating instance_info_cache with network_info: [{"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Releasing lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Instance network_info: |[{"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] Acquired lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Refreshing network info cache for port ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Start _get_guest_xml network_info=[{"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:39:27 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:27 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405758879',display_name='tempest-TestVolumeSwap-server-405758879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405758879',id=6,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrvejGcvzLPwyJ1jY1zkiS140l66LNn4mce8ALDP5rYlFhPaZWSMERRIZw79HtHLg7bdAPYzS3qdr3l+SKqBz94Xc2wX7UDCEXDyrLQw5azwToIEcr3nDpUeTEPeTWjAA==',key_name='tempest-keypair-2079128480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5c54782056d4249a0e5bb9bae2d35f7',ramdisk_id='',reservation_id='r-ps3hkpru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1170048861',owner_user_name='tempest-TestVolumeSwap-1170048861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3239db433fd64ee698d8c47071b12016',uuid=6f285797-8d8a-4b6f-9f39-c79b71124f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Converting VIF {"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:39:27 user nova-compute[73450]:   <uuid>6f285797-8d8a-4b6f-9f39-c79b71124f69</uuid>
Aug 16 16:39:27 user nova-compute[73450]:   <name>instance-00000006</name>
Aug 16 16:39:27 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:39:27 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:39:27 user nova-compute[73450]:   <metadata>
Aug 16 16:39:27 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:39:27 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:39:27 user nova-compute[73450]:       <nova:name>tempest-TestVolumeSwap-server-405758879</nova:name>
Aug 16 16:39:27 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:39:27</nova:creationTime>
Aug 16 16:39:27 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:39:27 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:39:27 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:39:27 user nova-compute[73450]:       <nova:owner>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:user uuid="3239db433fd64ee698d8c47071b12016">tempest-TestVolumeSwap-1170048861-project-member</nova:user>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:project uuid="e5c54782056d4249a0e5bb9bae2d35f7">tempest-TestVolumeSwap-1170048861</nova:project>
Aug 16 16:39:27 user nova-compute[73450]:       </nova:owner>
Aug 16 16:39:27 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:39:27 user nova-compute[73450]:       <nova:ports>
Aug 16 16:39:27 user nova-compute[73450]:         <nova:port uuid="ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2">
Aug 16 16:39:27 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:39:27 user nova-compute[73450]:         </nova:port>
Aug 16 16:39:27 user nova-compute[73450]:       </nova:ports>
Aug 16 16:39:27 user nova-compute[73450]:     </nova:instance>
Aug 16 16:39:27 user nova-compute[73450]:   </metadata>
Aug 16 16:39:27 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:39:27 user nova-compute[73450]:     <system>
Aug 16 16:39:27 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:39:27 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:39:27 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:39:27 user nova-compute[73450]:       <entry name="serial">6f285797-8d8a-4b6f-9f39-c79b71124f69</entry>
Aug 16 16:39:27 user nova-compute[73450]:       <entry name="uuid">6f285797-8d8a-4b6f-9f39-c79b71124f69</entry>
Aug 16 16:39:27 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:39:27 user nova-compute[73450]:     </system>
Aug 16 16:39:27 user nova-compute[73450]:   </sysinfo>
Aug 16 16:39:27 user nova-compute[73450]:   <os>
Aug 16 16:39:27 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:39:27 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:39:27 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:39:27 user nova-compute[73450]:   </os>
Aug 16 16:39:27 user nova-compute[73450]:   <features>
Aug 16 16:39:27 user nova-compute[73450]:     <acpi/>
Aug 16 16:39:27 user nova-compute[73450]:     <apic/>
Aug 16 16:39:27 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:39:27 user nova-compute[73450]:   </features>
Aug 16 16:39:27 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:39:27 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:39:27 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:39:27 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:39:27 user nova-compute[73450]:   </clock>
Aug 16 16:39:27 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:39:27 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:39:27 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:39:27 user nova-compute[73450]:   </cpu>
Aug 16 16:39:27 user nova-compute[73450]:   <devices>
Aug 16 16:39:27 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:39:27 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:39:27 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk"/>
Aug 16 16:39:27 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:39:27 user nova-compute[73450]:     </disk>
Aug 16 16:39:27 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:39:27 user nova-compute[73450]:       <mac address="fa:16:3e:ac:8e:aa"/>
Aug 16 16:39:27 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:27 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:39:27 user nova-compute[73450]:       <target dev="tapab7a46b5-a5"/>
Aug 16 16:39:27 user nova-compute[73450]:     </interface>
Aug 16 16:39:27 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:39:27 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/console.log" append="off"/>
Aug 16 16:39:27 user nova-compute[73450]:     </serial>
Aug 16 16:39:27 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:39:27 user nova-compute[73450]:     <video>
Aug 16 16:39:27 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:27 user nova-compute[73450]:     </video>
Aug 16 16:39:27 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:39:27 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:39:27 user nova-compute[73450]:     </rng>
Aug 16 16:39:27 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:39:27 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:39:27 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:39:27 user nova-compute[73450]:     </memballoon>
Aug 16 16:39:27 user nova-compute[73450]:   </devices>
Aug 16 16:39:27 user nova-compute[73450]: </domain>
Aug 16 16:39:27 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405758879',display_name='tempest-TestVolumeSwap-server-405758879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405758879',id=6,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrvejGcvzLPwyJ1jY1zkiS140l66LNn4mce8ALDP5rYlFhPaZWSMERRIZw79HtHLg7bdAPYzS3qdr3l+SKqBz94Xc2wX7UDCEXDyrLQw5azwToIEcr3nDpUeTEPeTWjAA==',key_name='tempest-keypair-2079128480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5c54782056d4249a0e5bb9bae2d35f7',ramdisk_id='',reservation_id='r-ps3hkpru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1170048861',owner_user_name='tempest-TestVolumeSwap-1170048861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3239db433fd64ee698d8c47071b12016',uuid=6f285797-8d8a-4b6f-9f39-c79b71124f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Converting VIF {"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG os_vif [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab7a46b5-a5, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab7a46b5-a5, col_values=(('external_ids', {'iface-id': 'ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:8e:aa', 'vm-uuid': '6f285797-8d8a-4b6f-9f39-c79b71124f69'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:27 user nova-compute[73450]: INFO os_vif [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5')
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] No VIF found with MAC fa:16:3e:ac:8e:aa, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.782s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:39:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:39:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Creating image(s)
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updated VIF entry in instance network info cache for port ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating instance_info_cache with network_info: [{"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-46f30503-f0b6-4569-9c5b-6b129f89007e req-dc982cd7-dbf5-428f-8ddf-6fec66f72691 service nova] Releasing lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:27 user nova-compute[73450]: DEBUG nova.policy [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9fbb80fe4c4693b017e36230b65e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aeededc22ac49fe953a06bc61cb0fec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.283s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.235s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk 1073741824" returned: 0 in 0.092s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-2b7af70a-9ab9-467d-bdb4-9f835ed2d7eb req-d40fd195-6415-4bc9-87ee-a989ba625e01 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2b7af70a-9ab9-467d-bdb4-9f835ed2d7eb req-d40fd195-6415-4bc9-87ee-a989ba625e01 service nova] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2b7af70a-9ab9-467d-bdb4-9f835ed2d7eb req-d40fd195-6415-4bc9-87ee-a989ba625e01 service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2b7af70a-9ab9-467d-bdb4-9f835ed2d7eb req-d40fd195-6415-4bc9-87ee-a989ba625e01 service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-2b7af70a-9ab9-467d-bdb4-9f835ed2d7eb req-d40fd195-6415-4bc9-87ee-a989ba625e01 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] No waiting events found dispatching network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:28 user nova-compute[73450]: WARNING nova.compute.manager [req-2b7af70a-9ab9-467d-bdb4-9f835ed2d7eb req-d40fd195-6415-4bc9-87ee-a989ba625e01 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received unexpected event network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d for instance with vm_state active and task_state None.
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:28 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Cannot resize image /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'migration_context' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Ensure instance console log exists: /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-04d12d16-2cbe-4ec8-8a0b-44b99f5b6a1b req-2bfce85b-991f-4969-8714-51ac5fa21d12 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-04d12d16-2cbe-4ec8-8a0b-44b99f5b6a1b req-2bfce85b-991f-4969-8714-51ac5fa21d12 service nova] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-04d12d16-2cbe-4ec8-8a0b-44b99f5b6a1b req-2bfce85b-991f-4969-8714-51ac5fa21d12 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-04d12d16-2cbe-4ec8-8a0b-44b99f5b6a1b req-2bfce85b-991f-4969-8714-51ac5fa21d12 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-04d12d16-2cbe-4ec8-8a0b-44b99f5b6a1b req-2bfce85b-991f-4969-8714-51ac5fa21d12 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] No waiting events found dispatching network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:29 user nova-compute[73450]: WARNING nova.compute.manager [req-04d12d16-2cbe-4ec8-8a0b-44b99f5b6a1b req-2bfce85b-991f-4969-8714-51ac5fa21d12 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received unexpected event network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 for instance with vm_state building and task_state spawning.
Aug 16 16:39:29 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Successfully created port: 28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] No waiting events found dispatching network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:30 user nova-compute[73450]: WARNING nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received unexpected event network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d for instance with vm_state active and task_state None.
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] No waiting events found dispatching network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:30 user nova-compute[73450]: WARNING nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received unexpected event network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 for instance with vm_state active and task_state None.
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] No waiting events found dispatching network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:30 user nova-compute[73450]: WARNING nova.compute.manager [req-f3c32874-89b6-4308-b89e-46d2d1553b7e req-1fd945f5-4082-477e-b4a1-8f4d9b589622 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received unexpected event network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 for instance with vm_state active and task_state None.
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Successfully updated port: 28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquired lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:30 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-5ca94434-7f81-4ef6-b10d-578aeef2bc0e req-7c64a881-eb3a-446c-aaf3-d0819e8a14f2 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5ca94434-7f81-4ef6-b10d-578aeef2bc0e req-7c64a881-eb3a-446c-aaf3-d0819e8a14f2 service nova] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5ca94434-7f81-4ef6-b10d-578aeef2bc0e req-7c64a881-eb3a-446c-aaf3-d0819e8a14f2 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5ca94434-7f81-4ef6-b10d-578aeef2bc0e req-7c64a881-eb3a-446c-aaf3-d0819e8a14f2 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-5ca94434-7f81-4ef6-b10d-578aeef2bc0e req-7c64a881-eb3a-446c-aaf3-d0819e8a14f2 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] No waiting events found dispatching network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:31 user nova-compute[73450]: WARNING nova.compute.manager [req-5ca94434-7f81-4ef6-b10d-578aeef2bc0e req-7c64a881-eb3a-446c-aaf3-d0819e8a14f2 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received unexpected event network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 for instance with vm_state building and task_state spawning.
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Releasing lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Instance network_info: |[{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Start _get_guest_xml network_info=[{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:39:31 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:31 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'pci_devices' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:39:31 user nova-compute[73450]:   <uuid>408dc4d1-cbe3-4c99-b709-1956d987209a</uuid>
Aug 16 16:39:31 user nova-compute[73450]:   <name>instance-00000007</name>
Aug 16 16:39:31 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:39:31 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:39:31 user nova-compute[73450]:   <metadata>
Aug 16 16:39:31 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:39:31 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:39:31 user nova-compute[73450]:       <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:39:31 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:39:31</nova:creationTime>
Aug 16 16:39:31 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:39:31 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:39:31 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:39:31 user nova-compute[73450]:       <nova:owner>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:39:31 user nova-compute[73450]:       </nova:owner>
Aug 16 16:39:31 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:39:31 user nova-compute[73450]:       <nova:ports>
Aug 16 16:39:31 user nova-compute[73450]:         <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:39:31 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:39:31 user nova-compute[73450]:         </nova:port>
Aug 16 16:39:31 user nova-compute[73450]:       </nova:ports>
Aug 16 16:39:31 user nova-compute[73450]:     </nova:instance>
Aug 16 16:39:31 user nova-compute[73450]:   </metadata>
Aug 16 16:39:31 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:39:31 user nova-compute[73450]:     <system>
Aug 16 16:39:31 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:39:31 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:39:31 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:39:31 user nova-compute[73450]:       <entry name="serial">408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:39:31 user nova-compute[73450]:       <entry name="uuid">408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:39:31 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:39:31 user nova-compute[73450]:     </system>
Aug 16 16:39:31 user nova-compute[73450]:   </sysinfo>
Aug 16 16:39:31 user nova-compute[73450]:   <os>
Aug 16 16:39:31 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:39:31 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:39:31 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:39:31 user nova-compute[73450]:   </os>
Aug 16 16:39:31 user nova-compute[73450]:   <features>
Aug 16 16:39:31 user nova-compute[73450]:     <acpi/>
Aug 16 16:39:31 user nova-compute[73450]:     <apic/>
Aug 16 16:39:31 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:39:31 user nova-compute[73450]:   </features>
Aug 16 16:39:31 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:39:31 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:39:31 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:39:31 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:39:31 user nova-compute[73450]:   </clock>
Aug 16 16:39:31 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:39:31 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:39:31 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:39:31 user nova-compute[73450]:   </cpu>
Aug 16 16:39:31 user nova-compute[73450]:   <devices>
Aug 16 16:39:31 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:39:31 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:39:31 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk"/>
Aug 16 16:39:31 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:39:31 user nova-compute[73450]:     </disk>
Aug 16 16:39:31 user nova-compute[73450]:     <disk type="file" device="cdrom">
Aug 16 16:39:31 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 16:39:31 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config"/>
Aug 16 16:39:31 user nova-compute[73450]:       <target dev="hda" bus="ide"/>
Aug 16 16:39:31 user nova-compute[73450]:     </disk>
Aug 16 16:39:31 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:39:31 user nova-compute[73450]:       <mac address="fa:16:3e:83:79:d8"/>
Aug 16 16:39:31 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:31 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:39:31 user nova-compute[73450]:       <target dev="tap28373f47-5f"/>
Aug 16 16:39:31 user nova-compute[73450]:     </interface>
Aug 16 16:39:31 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:39:31 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log" append="off"/>
Aug 16 16:39:31 user nova-compute[73450]:     </serial>
Aug 16 16:39:31 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:39:31 user nova-compute[73450]:     <video>
Aug 16 16:39:31 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:31 user nova-compute[73450]:     </video>
Aug 16 16:39:31 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:39:31 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:39:31 user nova-compute[73450]:     </rng>
Aug 16 16:39:31 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:39:31 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:39:31 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:39:31 user nova-compute[73450]:     </memballoon>
Aug 16 16:39:31 user nova-compute[73450]:   </devices>
Aug 16 16:39:31 user nova-compute[73450]: </domain>
Aug 16 16:39:31 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG os_vif [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28373f47-5f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28373f47-5f, col_values=(('external_ids', {'iface-id': '28373f47-5f2f-4c07-8188-7b3edb9cc645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:79:d8', 'vm-uuid': '408dc4d1-cbe3-4c99-b709-1956d987209a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:31 user nova-compute[73450]: INFO os_vif [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f')
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No BDM found with device name hda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No VIF found with MAC fa:16:3e:83:79:d8, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:39:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Using config drive
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203971.8321922, 6f285797-8d8a-4b6f-9f39-c79b71124f69 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] VM Resumed (Lifecycle Event)
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Instance spawned successfully.
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203971.837467, 6f285797-8d8a-4b6f-9f39-c79b71124f69 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] VM Started (Lifecycle Event)
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:31 user nova-compute[73450]: INFO nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Took 7.63 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Creating config drive at /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config
Aug 16 16:39:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4473a51v {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4473a51v" returned: 0 in 0.066s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:32 user nova-compute[73450]: INFO nova.compute.manager [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Took 8.79 seconds to build instance.
Aug 16 16:39:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6af72ff5-8535-4bde-ac81-d599a8c8b0c4 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.940s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-changed-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Refreshing instance network info cache due to event network-changed-28373f47-5f2f-4c07-8188-7b3edb9cc645. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:39:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] Acquiring lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] Acquired lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:32 user nova-compute[73450]: DEBUG nova.network.neutron [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Refreshing network info cache for port 28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updated VIF entry in instance network info cache for port 28373f47-5f2f-4c07-8188-7b3edb9cc645. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2f91809-484d-4ec9-849d-c13dad6904cb req-42586a39-3f3a-44e0-9e0e-a6db90f919a4 service nova] Releasing lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-156c1510-475b-4cc3-aefd-28e77ca78e27 req-bf9a4489-21c8-42c5-9aa0-9568bcfbc19b service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-156c1510-475b-4cc3-aefd-28e77ca78e27 req-bf9a4489-21c8-42c5-9aa0-9568bcfbc19b service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-156c1510-475b-4cc3-aefd-28e77ca78e27 req-bf9a4489-21c8-42c5-9aa0-9568bcfbc19b service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-156c1510-475b-4cc3-aefd-28e77ca78e27 req-bf9a4489-21c8-42c5-9aa0-9568bcfbc19b service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-156c1510-475b-4cc3-aefd-28e77ca78e27 req-bf9a4489-21c8-42c5-9aa0-9568bcfbc19b service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:34 user nova-compute[73450]: WARNING nova.compute.manager [req-156c1510-475b-4cc3-aefd-28e77ca78e27 req-bf9a4489-21c8-42c5-9aa0-9568bcfbc19b service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 for instance with vm_state building and task_state spawning.
Aug 16 16:39:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 16:39:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 16:39:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 16:39:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-b509009a-1d56-4b48-a61c-b45d330b9ca4 req-6bdca6c8-f4c6-46d2-ac4f-88b22b9b6837 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b509009a-1d56-4b48-a61c-b45d330b9ca4 req-6bdca6c8-f4c6-46d2-ac4f-88b22b9b6837 service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b509009a-1d56-4b48-a61c-b45d330b9ca4 req-6bdca6c8-f4c6-46d2-ac4f-88b22b9b6837 service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b509009a-1d56-4b48-a61c-b45d330b9ca4 req-6bdca6c8-f4c6-46d2-ac4f-88b22b9b6837 service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-b509009a-1d56-4b48-a61c-b45d330b9ca4 req-6bdca6c8-f4c6-46d2-ac4f-88b22b9b6837 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:36 user nova-compute[73450]: WARNING nova.compute.manager [req-b509009a-1d56-4b48-a61c-b45d330b9ca4 req-6bdca6c8-f4c6-46d2-ac4f-88b22b9b6837 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 for instance with vm_state building and task_state spawning.
Aug 16 16:39:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203976.8839874, 408dc4d1-cbe3-4c99-b709-1956d987209a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:36 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] VM Resumed (Lifecycle Event)
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:39:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Instance spawned successfully.
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:39:36 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:36 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692203976.8846176, 408dc4d1-cbe3-4c99-b709-1956d987209a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:39:36 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] VM Started (Lifecycle Event)
Aug 16 16:39:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:39:37 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:39:37 user nova-compute[73450]: INFO nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Took 9.25 seconds to spawn the instance on the hypervisor.
Aug 16 16:39:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:39:37 user nova-compute[73450]: INFO nova.compute.manager [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Took 10.64 seconds to build instance.
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b1b5d63-6230-4f70-aaa8-3694ef042b73 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.833s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=24.594402313232422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 841c9d46-e3ce-4663-9ac0-2d3c1d56711f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 42484cde-66d6-4816-962b-912f6df59156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 408dc4d1-cbe3-4c99-b709-1956d987209a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:39:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:39:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid 66f48511-dafc-457b-817e-5bfe039cefa1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updating instance_info_cache with network_info: [{"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:39:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:39:48 user nova-compute[73450]: INFO nova.compute.claims [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Claim successful on node user
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 16:39:48 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:39:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:39:49 user nova-compute[73450]: INFO nova.virt.block_device [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Booting with volume 271210ae-b56b-4e19-a04a-c53c352dd3a9 at /dev/vda
Aug 16 16:39:49 user nova-compute[73450]: DEBUG nova.policy [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1d1da8ff1204e8490b25aa909744e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41319fdc350640e18bd748deb70a3efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:39:49 user nova-compute[73450]: DEBUG os_brick.utils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:39:49 user nova-compute[73450]: INFO oslo.privsep.daemon [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp4ej2hivd/privsep.sock']
Aug 16 16:39:49 user sudo[84234]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp4ej2hivd/privsep.sock
Aug 16 16:39:49 user sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 16:39:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Successfully created port: 1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Successfully updated port: 1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquired lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-changed-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Refreshing instance network info cache due to event network-changed-1895c3ed-6e8a-4cab-9eb9-d54458cb589f. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] Acquiring lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:51 user sudo[84234]: pam_unix(sudo:session): session closed for user root
Aug 16 16:39:51 user nova-compute[73450]: INFO oslo.privsep.daemon [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Spawned new privsep daemon via rootwrap
Aug 16 16:39:51 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 16:39:51 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 16:39:51 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 16:39:51 user nova-compute[73450]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84237
Aug 16 16:39:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e526800-7d46-4d62-b0b9-822c1e433e18]: (2,) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.051s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf815ef-ae3f-46e2-9c7a-51f77bff96b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:39:52 user nova-compute[73450]: WARNING os_brick.initiator.connectors.nvmeof [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.094s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec3711d-ddfa-49e7-a675-0d5d07009056]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00f68f-1d35-418e-9d1f-558ea6da3343]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d7ce51-4a4d-4ff8-8664-c905dc89fca0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:39:52 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[389fc967-8b90-453c-95b1-bb139cfc2f7e]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== get_connector_properties: return (2900ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updating existing volume attachment record: 364e2c32-3793-4ebc-a9fc-ec4b18e8d1fd {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updating instance_info_cache with network_info: [{"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Releasing lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance network_info: |[{"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] Acquired lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG nova.network.neutron [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Refreshing network info cache for port 1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG nova.network.neutron [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updated VIF entry in instance network info cache for port 1895c3ed-6e8a-4cab-9eb9-d54458cb589f. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG nova.network.neutron [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updating instance_info_cache with network_info: [{"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-137e0913-6fb6-451b-a0a9-5d24efc12bfc req-3724134d-e2a6-49b1-9c04-df4e7250bb1b service nova] Releasing lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:39:54 user nova-compute[73450]: INFO nova.compute.claims [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Claim successful on node user
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:39:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.policy [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc6acf577d674ef1aed6344f82b84947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f20872edf0443fba4ce8818f58855d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:39:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Creating image(s)
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "/opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "/opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk 1073741824" returned: 0 in 0.076s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Successfully created port: ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Cannot resize image /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lazy-loading 'migration_context' on Instance uuid a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Ensure instance console log exists: /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Successfully updated port: ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "refresh_cache-a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquired lock "refresh_cache-a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-changed-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Refreshing instance network info cache due to event network-changed-ac44580d-5f61-4d1a-a57d-a6ec838dd484. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] Acquiring lock "refresh_cache-a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Updating instance_info_cache with network_info: [{"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Releasing lock "refresh_cache-a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Instance network_info: |[{"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] Acquired lock "refresh_cache-a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Refreshing network info cache for port ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Start _get_guest_xml network_info=[{"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:39:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1779795218',display_name='tempest-VolumesActionsTest-instance-1779795218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1779795218',id=9,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f20872edf0443fba4ce8818f58855d0',ramdisk_id='',reservation_id='r-32fnxzfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1959607433',owner_user_name='tempest-VolumesActionsTest-1959607433-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:55Z,user_data=None,user_id='dc6acf577d674ef1aed6344f82b84947',uuid=a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Converting VIF {"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lazy-loading 'pci_devices' on Instance uuid a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:39:56 user nova-compute[73450]:   <uuid>a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac</uuid>
Aug 16 16:39:56 user nova-compute[73450]:   <name>instance-00000009</name>
Aug 16 16:39:56 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:39:56 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:39:56 user nova-compute[73450]:   <metadata>
Aug 16 16:39:56 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:39:56 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:39:56 user nova-compute[73450]:       <nova:name>tempest-VolumesActionsTest-instance-1779795218</nova:name>
Aug 16 16:39:56 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:39:56</nova:creationTime>
Aug 16 16:39:56 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:39:56 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:39:56 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:39:56 user nova-compute[73450]:       <nova:owner>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:user uuid="dc6acf577d674ef1aed6344f82b84947">tempest-VolumesActionsTest-1959607433-project-member</nova:user>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:project uuid="1f20872edf0443fba4ce8818f58855d0">tempest-VolumesActionsTest-1959607433</nova:project>
Aug 16 16:39:56 user nova-compute[73450]:       </nova:owner>
Aug 16 16:39:56 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:39:56 user nova-compute[73450]:       <nova:ports>
Aug 16 16:39:56 user nova-compute[73450]:         <nova:port uuid="ac44580d-5f61-4d1a-a57d-a6ec838dd484">
Aug 16 16:39:56 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 16:39:56 user nova-compute[73450]:         </nova:port>
Aug 16 16:39:56 user nova-compute[73450]:       </nova:ports>
Aug 16 16:39:56 user nova-compute[73450]:     </nova:instance>
Aug 16 16:39:56 user nova-compute[73450]:   </metadata>
Aug 16 16:39:56 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:39:56 user nova-compute[73450]:     <system>
Aug 16 16:39:56 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:39:56 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:39:56 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:39:56 user nova-compute[73450]:       <entry name="serial">a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac</entry>
Aug 16 16:39:56 user nova-compute[73450]:       <entry name="uuid">a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac</entry>
Aug 16 16:39:56 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:39:56 user nova-compute[73450]:     </system>
Aug 16 16:39:56 user nova-compute[73450]:   </sysinfo>
Aug 16 16:39:56 user nova-compute[73450]:   <os>
Aug 16 16:39:56 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:39:56 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:39:56 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:39:56 user nova-compute[73450]:   </os>
Aug 16 16:39:56 user nova-compute[73450]:   <features>
Aug 16 16:39:56 user nova-compute[73450]:     <acpi/>
Aug 16 16:39:56 user nova-compute[73450]:     <apic/>
Aug 16 16:39:56 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:39:56 user nova-compute[73450]:   </features>
Aug 16 16:39:56 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:39:56 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:39:56 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:39:56 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:39:56 user nova-compute[73450]:   </clock>
Aug 16 16:39:56 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:39:56 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:39:56 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:39:56 user nova-compute[73450]:   </cpu>
Aug 16 16:39:56 user nova-compute[73450]:   <devices>
Aug 16 16:39:56 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:39:56 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:39:56 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk"/>
Aug 16 16:39:56 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:39:56 user nova-compute[73450]:     </disk>
Aug 16 16:39:56 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:39:56 user nova-compute[73450]:       <mac address="fa:16:3e:a9:68:92"/>
Aug 16 16:39:56 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:56 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:39:56 user nova-compute[73450]:       <target dev="tapac44580d-5f"/>
Aug 16 16:39:56 user nova-compute[73450]:     </interface>
Aug 16 16:39:56 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:39:56 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/console.log" append="off"/>
Aug 16 16:39:56 user nova-compute[73450]:     </serial>
Aug 16 16:39:56 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:39:56 user nova-compute[73450]:     <video>
Aug 16 16:39:56 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:39:56 user nova-compute[73450]:     </video>
Aug 16 16:39:56 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:39:56 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:39:56 user nova-compute[73450]:     </rng>
Aug 16 16:39:56 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:39:56 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:39:56 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:39:56 user nova-compute[73450]:     </memballoon>
Aug 16 16:39:56 user nova-compute[73450]:   </devices>
Aug 16 16:39:56 user nova-compute[73450]: </domain>
Aug 16 16:39:56 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1779795218',display_name='tempest-VolumesActionsTest-instance-1779795218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1779795218',id=9,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f20872edf0443fba4ce8818f58855d0',ramdisk_id='',reservation_id='r-32fnxzfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1959607433',owner_user_name='tempest-VolumesActionsTest-1959607433-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:55Z,user_data=None,user_id='dc6acf577d674ef1aed6344f82b84947',uuid=a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Converting VIF {"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG os_vif [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac44580d-5f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac44580d-5f, col_values=(('external_ids', {'iface-id': 'ac44580d-5f61-4d1a-a57d-a6ec838dd484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:68:92', 'vm-uuid': 'a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:56 user nova-compute[73450]: INFO os_vif [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f')
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] No VIF found with MAC fa:16:3e:a9:68:92, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Updated VIF entry in instance network info cache for port ac44580d-5f61-4d1a-a57d-a6ec838dd484. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Updating instance_info_cache with network_info: [{"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:39:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4359d1d-de34-4909-96dc-0ab90a55be7b req-252e23f2-d60d-4c31-957d-3febb7d1c752 service nova] Releasing lock "refresh_cache-a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-238601a1-f46b-478d-b833-c4a4b8beea1f req-163882e1-b4d0-45ea-a92a-4484a5aba553 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-238601a1-f46b-478d-b833-c4a4b8beea1f req-163882e1-b4d0-45ea-a92a-4484a5aba553 service nova] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-238601a1-f46b-478d-b833-c4a4b8beea1f req-163882e1-b4d0-45ea-a92a-4484a5aba553 service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-238601a1-f46b-478d-b833-c4a4b8beea1f req-163882e1-b4d0-45ea-a92a-4484a5aba553 service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-238601a1-f46b-478d-b833-c4a4b8beea1f req-163882e1-b4d0-45ea-a92a-4484a5aba553 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] No waiting events found dispatching network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:39:58 user nova-compute[73450]: WARNING nova.compute.manager [req-238601a1-f46b-478d-b833-c4a4b8beea1f req-163882e1-b4d0-45ea-a92a-4484a5aba553 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received unexpected event network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 for instance with vm_state building and task_state spawning.
Aug 16 16:39:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:39:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204000.4392679, a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] VM Resumed (Lifecycle Event)
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Instance spawned successfully.
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-d213cf72-c1ab-475a-b455-c971d2f846b8 req-3def4a4e-fbb9-4562-9dab-69c0a85665fc service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d213cf72-c1ab-475a-b455-c971d2f846b8 req-3def4a4e-fbb9-4562-9dab-69c0a85665fc service nova] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d213cf72-c1ab-475a-b455-c971d2f846b8 req-3def4a4e-fbb9-4562-9dab-69c0a85665fc service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d213cf72-c1ab-475a-b455-c971d2f846b8 req-3def4a4e-fbb9-4562-9dab-69c0a85665fc service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-d213cf72-c1ab-475a-b455-c971d2f846b8 req-3def4a4e-fbb9-4562-9dab-69c0a85665fc service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] No waiting events found dispatching network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:40:00 user nova-compute[73450]: WARNING nova.compute.manager [req-d213cf72-c1ab-475a-b455-c971d2f846b8 req-3def4a4e-fbb9-4562-9dab-69c0a85665fc service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received unexpected event network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 for instance with vm_state building and task_state spawning.
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204000.4428985, a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] VM Started (Lifecycle Event)
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 16 16:40:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:00 user nova-compute[73450]: INFO nova.compute.manager [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Took 6.67 seconds to build instance.
Aug 16 16:40:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1ed2745b-5f0e-4383-9e43-c98d390b6eb3 tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:40:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Creating image(s)
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Ensure instance console log exists: /opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Start _get_guest_xml network_info=[{"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '364e2c32-3793-4ebc-a9fc-ec4b18e8d1fd', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '032e6ee8-4545-4867-a8ed-4076ed273174', 'attached_at': '', 'detached_at': '', 'volume_id': '271210ae-b56b-4e19-a04a-c53c352dd3a9', 'serial': '271210ae-b56b-4e19-a04a-c53c352dd3a9'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:40:05 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:40:05 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connector [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Factory for ISCSI on None {{(pid=73450) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:40:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:40:05 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78600f7-a1e5-4b70-b9a7-750793590caa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:40:05 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7d311-6374-4307-8a78-90e28955d595]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9] added
Aug 16 16:40:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[940a1b3f-0826-4886-8f57-5125093acd05]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a102ee93-227c-4447-ae00-2b5388550397]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vOLdAwYH {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vOLdAwYH" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[244bb6c4-f3b4-495e-b7ff-b1e2342d8f79]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vOLdAwYH'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967750e-62fb-4f3d-9545-150f100407a7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa9538e-bc60-4b87-ac27-ee08536f938d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 16:40:06 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 16:40:06 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:40:06 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 16:40:06 user nova-compute[73450]: 
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1dc99a-d211-4d1c-808b-fd3294e6e89d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]
Aug 16 16:40:06 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.
Aug 16 16:40:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec30f92-5828-483c-89e2-2f55c27bfbcf]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e5eaf-adec-4e71-bb52-36ff38af4b4b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:40:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:40:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98266b-b2f6-423e-ada4-b0aa98961ad6]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:40:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26230396237356634', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230396237356634', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1778060136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1778060136',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGQW4pBqszV7GkT1DSqckRZr1tzOMllClEWD6zRoXgdh3JcdTpIdPRXKM3Rx82f0o7HhR4UciWWoPevsp5DyJaK5ckZnot8UqNXmT795b50ZFx8Z7y7dSRpvnbQLaQ5ow==',key_name='tempest-keypair-400554828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41319fdc350640e18bd748deb70a3efc',ramdisk_id='',reservation_id='r-4z9dgjse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-592429353',owner_user_name='tempest-ServerActionsV293TestJSON-592429353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1d1da8ff1204e8490b25aa909744e65',uuid=032e6ee8-4545-4867-a8ed-4076ed273174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converting VIF {"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'pci_devices' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:40:07 user nova-compute[73450]:   <uuid>032e6ee8-4545-4867-a8ed-4076ed273174</uuid>
Aug 16 16:40:07 user nova-compute[73450]:   <name>instance-00000008</name>
Aug 16 16:40:07 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:40:07 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:40:07 user nova-compute[73450]:   <metadata>
Aug 16 16:40:07 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:40:07 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:40:07 user nova-compute[73450]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1778060136</nova:name>
Aug 16 16:40:07 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:40:05</nova:creationTime>
Aug 16 16:40:07 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:40:07 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:40:07 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:40:07 user nova-compute[73450]:       <nova:owner>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:user uuid="e1d1da8ff1204e8490b25aa909744e65">tempest-ServerActionsV293TestJSON-592429353-project-member</nova:user>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:project uuid="41319fdc350640e18bd748deb70a3efc">tempest-ServerActionsV293TestJSON-592429353</nova:project>
Aug 16 16:40:07 user nova-compute[73450]:       </nova:owner>
Aug 16 16:40:07 user nova-compute[73450]:       <nova:ports>
Aug 16 16:40:07 user nova-compute[73450]:         <nova:port uuid="1895c3ed-6e8a-4cab-9eb9-d54458cb589f">
Aug 16 16:40:07 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 16:40:07 user nova-compute[73450]:         </nova:port>
Aug 16 16:40:07 user nova-compute[73450]:       </nova:ports>
Aug 16 16:40:07 user nova-compute[73450]:     </nova:instance>
Aug 16 16:40:07 user nova-compute[73450]:   </metadata>
Aug 16 16:40:07 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:40:07 user nova-compute[73450]:     <system>
Aug 16 16:40:07 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:40:07 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:40:07 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:40:07 user nova-compute[73450]:       <entry name="serial">032e6ee8-4545-4867-a8ed-4076ed273174</entry>
Aug 16 16:40:07 user nova-compute[73450]:       <entry name="uuid">032e6ee8-4545-4867-a8ed-4076ed273174</entry>
Aug 16 16:40:07 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:40:07 user nova-compute[73450]:     </system>
Aug 16 16:40:07 user nova-compute[73450]:   </sysinfo>
Aug 16 16:40:07 user nova-compute[73450]:   <os>
Aug 16 16:40:07 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:40:07 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:40:07 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:40:07 user nova-compute[73450]:   </os>
Aug 16 16:40:07 user nova-compute[73450]:   <features>
Aug 16 16:40:07 user nova-compute[73450]:     <acpi/>
Aug 16 16:40:07 user nova-compute[73450]:     <apic/>
Aug 16 16:40:07 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:40:07 user nova-compute[73450]:   </features>
Aug 16 16:40:07 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:40:07 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:40:07 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:40:07 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:40:07 user nova-compute[73450]:   </clock>
Aug 16 16:40:07 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:40:07 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:40:07 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:40:07 user nova-compute[73450]:   </cpu>
Aug 16 16:40:07 user nova-compute[73450]:   <devices>
Aug 16 16:40:07 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:40:07 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:40:07 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 16:40:07 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:40:07 user nova-compute[73450]:       <serial>271210ae-b56b-4e19-a04a-c53c352dd3a9</serial>
Aug 16 16:40:07 user nova-compute[73450]:     </disk>
Aug 16 16:40:07 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:40:07 user nova-compute[73450]:       <mac address="fa:16:3e:c3:27:33"/>
Aug 16 16:40:07 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:40:07 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:40:07 user nova-compute[73450]:       <target dev="tap1895c3ed-6e"/>
Aug 16 16:40:07 user nova-compute[73450]:     </interface>
Aug 16 16:40:07 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:40:07 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174/console.log" append="off"/>
Aug 16 16:40:07 user nova-compute[73450]:     </serial>
Aug 16 16:40:07 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:40:07 user nova-compute[73450]:     <video>
Aug 16 16:40:07 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:40:07 user nova-compute[73450]:     </video>
Aug 16 16:40:07 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:40:07 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:40:07 user nova-compute[73450]:     </rng>
Aug 16 16:40:07 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:40:07 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:40:07 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:40:07 user nova-compute[73450]:     </memballoon>
Aug 16 16:40:07 user nova-compute[73450]:   </devices>
Aug 16 16:40:07 user nova-compute[73450]: </domain>
Aug 16 16:40:07 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1778060136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1778060136',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGQW4pBqszV7GkT1DSqckRZr1tzOMllClEWD6zRoXgdh3JcdTpIdPRXKM3Rx82f0o7HhR4UciWWoPevsp5DyJaK5ckZnot8UqNXmT795b50ZFx8Z7y7dSRpvnbQLaQ5ow==',key_name='tempest-keypair-400554828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41319fdc350640e18bd748deb70a3efc',ramdisk_id='',reservation_id='r-4z9dgjse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-592429353',owner_user_name='tempest-ServerActionsV293TestJSON-592429353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1d1da8ff1204e8490b25aa909744e65',uuid=032e6ee8-4545-4867-a8ed-4076ed273174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converting VIF {"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG os_vif [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1895c3ed-6e, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1895c3ed-6e, col_values=(('external_ids', {'iface-id': '1895c3ed-6e8a-4cab-9eb9-d54458cb589f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:27:33', 'vm-uuid': '032e6ee8-4545-4867-a8ed-4076ed273174'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:07 user nova-compute[73450]: INFO os_vif [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e')
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:40:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] No VIF found with MAC fa:16:3e:c3:27:33, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:40:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-7edfde59-7b1d-4231-94c6-0d5581aa7ec0 req-97fc9e10-a0d8-403f-a6f1-dc873308519e service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7edfde59-7b1d-4231-94c6-0d5581aa7ec0 req-97fc9e10-a0d8-403f-a6f1-dc873308519e service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7edfde59-7b1d-4231-94c6-0d5581aa7ec0 req-97fc9e10-a0d8-403f-a6f1-dc873308519e service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7edfde59-7b1d-4231-94c6-0d5581aa7ec0 req-97fc9e10-a0d8-403f-a6f1-dc873308519e service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-7edfde59-7b1d-4231-94c6-0d5581aa7ec0 req-97fc9e10-a0d8-403f-a6f1-dc873308519e service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:40:09 user nova-compute[73450]: WARNING nova.compute.manager [req-7edfde59-7b1d-4231-94c6-0d5581aa7ec0 req-97fc9e10-a0d8-403f-a6f1-dc873308519e service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state building and task_state spawning.
Aug 16 16:40:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204010.9301245, 032e6ee8-4545-4867-a8ed-4076ed273174 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:40:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] VM Resumed (Lifecycle Event)
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:40:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance spawned successfully.
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:40:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:40:11 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204010.9314582, 032e6ee8-4545-4867-a8ed-4076ed273174 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:40:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] VM Started (Lifecycle Event)
Aug 16 16:40:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:40:11 user nova-compute[73450]: INFO nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 16 16:40:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:40:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-b18f24ab-d3da-4e32-973d-5be4709e5ea0 req-d1c683c7-caa5-4477-a6f7-7bfbbed20669 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b18f24ab-d3da-4e32-973d-5be4709e5ea0 req-d1c683c7-caa5-4477-a6f7-7bfbbed20669 service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b18f24ab-d3da-4e32-973d-5be4709e5ea0 req-d1c683c7-caa5-4477-a6f7-7bfbbed20669 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b18f24ab-d3da-4e32-973d-5be4709e5ea0 req-d1c683c7-caa5-4477-a6f7-7bfbbed20669 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-b18f24ab-d3da-4e32-973d-5be4709e5ea0 req-d1c683c7-caa5-4477-a6f7-7bfbbed20669 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:40:11 user nova-compute[73450]: WARNING nova.compute.manager [req-b18f24ab-d3da-4e32-973d-5be4709e5ea0 req-d1c683c7-caa5-4477-a6f7-7bfbbed20669 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state building and task_state spawning.
Aug 16 16:40:11 user nova-compute[73450]: INFO nova.compute.manager [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Took 22.77 seconds to build instance.
Aug 16 16:40:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ff2acf3-d2a9-474c-94dd-d1259b57be3f tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.945s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "486b238c-d628-47c4-9c94-92639359a3ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:40:25 user nova-compute[73450]: INFO nova.compute.claims [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Claim successful on node user
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:40:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:40:25 user nova-compute[73450]: INFO nova.virt.block_device [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Booting with volume fdfaeaf4-2c7d-4776-b504-93b245d48881 at /dev/vda
Aug 16 16:40:25 user nova-compute[73450]: DEBUG os_brick.utils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b800f80-40db-493e-ad38-f00a0899c1c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751082e-07c2-457f-b18d-8262795dfdde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG nova.policy [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e35928713fb435bafccc4978bc144a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb0646d9317488a81d54378cbe49855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6206b8-4cd9-454b-987f-3e3ee6497a14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ce32b-50ae-4eb6-8315-5921e9eb60b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:26 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a62f2-35aa-47c6-b6f8-658e43d5cb28]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG os_brick.utils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating existing volume attachment record: c0e63a86-1a89-4efc-b641-8140b47a8e92 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:40:26 user nova-compute[73450]: INFO nova.compute.claims [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Claim successful on node user
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully created port: 53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:40:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:40:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:40:27 user nova-compute[73450]: INFO nova.virt.block_device [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Booting with volume fb40c827-8f1a-445f-8b20-6fb2ed049953 at /dev/vda
Aug 16 16:40:27 user nova-compute[73450]: DEBUG os_brick.utils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87bb4bd-119c-4711-8cd7-b9f264ab0241]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96987f19-934d-4db9-b2db-a558523ebf3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ccaa65-bab4-4387-b88f-5466e55eb388]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef2a80-f82e-4b5a-a79c-8cedf1d3993f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:27 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a649f9-1ffd-4ca9-ad61-3fa7ae28fe25]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG os_brick.utils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating existing volume attachment record: 84ac85cb-6a5a-451f-bb38-173c42e97dba {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG nova.policy [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb490f4920d5493a86210353f9c561fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27f7949860446f6939fbe2b5bb17e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:40:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully created port: 168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:29 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully created port: 9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:29 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully created port: ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:30 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully created port: 57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:30 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully created port: 0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:30 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully created port: 454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:31 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully created port: f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully created port: 30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: 53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-53fe6daa-d147-4155-b9dd-089e4348294a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG nova.network.neutron [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port 53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:32 user nova-compute[73450]: DEBUG nova.network.neutron [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-69acaf1c-c649-4380-99e9-abb27468f6ee req-ea20731e-d432-4b7d-977a-1abbd8bf868f service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully created port: be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: 629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: 9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-629248db-6c03-48d6-b25a-522627171671. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:34 user nova-compute[73450]: DEBUG nova.network.neutron [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port 629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-9d264822-7290-4f01-b32b-873399b35475. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG nova.network.neutron [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: 37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-943e4a1c-5ecb-4f37-bde6-3b0704931e8d req-b6f59957-2d01-4a2b-a339-ab7dad706b2b service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "86049569-07b7-43dc-98b9-796174986401" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "86049569-07b7-43dc-98b9-796174986401" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:40:36 user nova-compute[73450]: INFO nova.compute.claims [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Claim successful on node user
Aug 16 16:40:36 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: 108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-37132e00-2ad0-42c5-95a0-229b165d7d31. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.network.neutron [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port 37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.network.neutron [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:40:37 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.policy [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b725deabeb954813950dc1841e6a09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ad8f16dae4525b9aecc767f42a261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:40:37 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Creating image(s)
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "/opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "/opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "/opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:37 user nova-compute[73450]: INFO nova.virt.block_device [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Booting with volume febc217e-61dc-4557-afaf-c8fa77d4c888 at /dev/vdb
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.235s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.network.neutron [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-108ead71-9f6a-4812-8b78-dd8b5986057f. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG nova.network.neutron [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG os_brick.utils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d530f78-5684-4df9-90cf-a5fff4808304]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99cf84-6678-4f74-b86a-19f7cd2d0659]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5b8e1e-ff04-4af1-b778-cf6a3fe55cfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaea7d38-4e85-4ddc-992c-3eee8d4874ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.238s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:38 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a98a4-8c22-481b-a4fd-ae79e7690a6d]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG os_brick.utils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating existing volume attachment record: 2729be66-9907-4992-bdb0-02c5157202c3 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk 1073741824" returned: 0 in 0.073s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.230s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Successfully created port: 921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: 168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Cannot resize image /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lazy-loading 'migration_context' on Instance uuid 86049569-07b7-43dc-98b9-796174986401 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Ensure instance console log exists: /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-422fac19-af8c-4f44-964e-0390f492f8d7 req-04ba3729-b7b7-4449-b219-b0126b3cdc1a service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: 0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-168798cb-2ee6-4d82-b564-0b62cd5734f2. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port 168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:39 user nova-compute[73450]: INFO nova.virt.block_device [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Booting with volume 4a0a8458-6cc7-4561-8a21-615d26598e45 at /dev/vdb
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Successfully updated port: 921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "refresh_cache-86049569-07b7-43dc-98b9-796174986401" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquired lock "refresh_cache-86049569-07b7-43dc-98b9-796174986401" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG os_brick.utils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-changed-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Refreshing instance network info cache due to event network-changed-921473b6-0483-4b8e-9aef-abf159c2337c. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] Acquiring lock "refresh_cache-86049569-07b7-43dc-98b9-796174986401" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a8a6c-836b-4528-9c90-bfcb75108b8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af279fa1-72d2-4f0d-9918-ecb3c328d65e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7215d86b-41da-4c74-ba55-18f5052a17ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1cc110-e5f8-4e60-911f-b4ac9491b264]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:39 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21dc228-f7dd-4a34-9ec9-cb78f25ab895]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG os_brick.utils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating existing volume attachment record: c05f3be4-2179-4ec8-b4c0-6f43fb6b86cd {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-0faec9d5-bcd6-45a8-b203-e01e4e470d87. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Updating instance_info_cache with network_info: [{"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Releasing lock "refresh_cache-86049569-07b7-43dc-98b9-796174986401" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Instance network_info: |[{"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] Acquired lock "refresh_cache-86049569-07b7-43dc-98b9-796174986401" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Refreshing network info cache for port 921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Start _get_guest_xml network_info=[{"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:40:39 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:40:39 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:40:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-536210619',display_name='tempest-ServersNegativeTestJSON-server-536210619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-536210619',id=12,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78ad8f16dae4525b9aecc767f42a261',ramdisk_id='',reservation_id='r-77pb03tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651503421',owner_user_name='tempest-ServersNegativeTestJSON-1651503421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:38Z,user_data=None,user_id='b725deabeb954813950dc1841e6a09fc',uuid=86049569-07b7-43dc-98b9-796174986401,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converting VIF {"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.objects.instance [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lazy-loading 'pci_devices' on Instance uuid 86049569-07b7-43dc-98b9-796174986401 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:40:40 user nova-compute[73450]:   <uuid>86049569-07b7-43dc-98b9-796174986401</uuid>
Aug 16 16:40:40 user nova-compute[73450]:   <name>instance-0000000c</name>
Aug 16 16:40:40 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:40:40 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:40:40 user nova-compute[73450]:   <metadata>
Aug 16 16:40:40 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:40:40 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:40:40 user nova-compute[73450]:       <nova:name>tempest-ServersNegativeTestJSON-server-536210619</nova:name>
Aug 16 16:40:40 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:40:39</nova:creationTime>
Aug 16 16:40:40 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:40:40 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:40:40 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:40:40 user nova-compute[73450]:       <nova:owner>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:user uuid="b725deabeb954813950dc1841e6a09fc">tempest-ServersNegativeTestJSON-1651503421-project-member</nova:user>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:project uuid="e78ad8f16dae4525b9aecc767f42a261">tempest-ServersNegativeTestJSON-1651503421</nova:project>
Aug 16 16:40:40 user nova-compute[73450]:       </nova:owner>
Aug 16 16:40:40 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:40:40 user nova-compute[73450]:       <nova:ports>
Aug 16 16:40:40 user nova-compute[73450]:         <nova:port uuid="921473b6-0483-4b8e-9aef-abf159c2337c">
Aug 16 16:40:40 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 16:40:40 user nova-compute[73450]:         </nova:port>
Aug 16 16:40:40 user nova-compute[73450]:       </nova:ports>
Aug 16 16:40:40 user nova-compute[73450]:     </nova:instance>
Aug 16 16:40:40 user nova-compute[73450]:   </metadata>
Aug 16 16:40:40 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:40:40 user nova-compute[73450]:     <system>
Aug 16 16:40:40 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:40:40 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:40:40 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:40:40 user nova-compute[73450]:       <entry name="serial">86049569-07b7-43dc-98b9-796174986401</entry>
Aug 16 16:40:40 user nova-compute[73450]:       <entry name="uuid">86049569-07b7-43dc-98b9-796174986401</entry>
Aug 16 16:40:40 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:40:40 user nova-compute[73450]:     </system>
Aug 16 16:40:40 user nova-compute[73450]:   </sysinfo>
Aug 16 16:40:40 user nova-compute[73450]:   <os>
Aug 16 16:40:40 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:40:40 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:40:40 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:40:40 user nova-compute[73450]:   </os>
Aug 16 16:40:40 user nova-compute[73450]:   <features>
Aug 16 16:40:40 user nova-compute[73450]:     <acpi/>
Aug 16 16:40:40 user nova-compute[73450]:     <apic/>
Aug 16 16:40:40 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:40:40 user nova-compute[73450]:   </features>
Aug 16 16:40:40 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:40:40 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:40:40 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:40:40 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:40:40 user nova-compute[73450]:   </clock>
Aug 16 16:40:40 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:40:40 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:40:40 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:40:40 user nova-compute[73450]:   </cpu>
Aug 16 16:40:40 user nova-compute[73450]:   <devices>
Aug 16 16:40:40 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:40:40 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:40:40 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk"/>
Aug 16 16:40:40 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:40:40 user nova-compute[73450]:     </disk>
Aug 16 16:40:40 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:40:40 user nova-compute[73450]:       <mac address="fa:16:3e:bd:d0:77"/>
Aug 16 16:40:40 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:40:40 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:40:40 user nova-compute[73450]:       <target dev="tap921473b6-04"/>
Aug 16 16:40:40 user nova-compute[73450]:     </interface>
Aug 16 16:40:40 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:40:40 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/console.log" append="off"/>
Aug 16 16:40:40 user nova-compute[73450]:     </serial>
Aug 16 16:40:40 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:40:40 user nova-compute[73450]:     <video>
Aug 16 16:40:40 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:40:40 user nova-compute[73450]:     </video>
Aug 16 16:40:40 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:40:40 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:40:40 user nova-compute[73450]:     </rng>
Aug 16 16:40:40 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:40:40 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:40:40 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:40:40 user nova-compute[73450]:     </memballoon>
Aug 16 16:40:40 user nova-compute[73450]:   </devices>
Aug 16 16:40:40 user nova-compute[73450]: </domain>
Aug 16 16:40:40 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-536210619',display_name='tempest-ServersNegativeTestJSON-server-536210619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-536210619',id=12,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78ad8f16dae4525b9aecc767f42a261',ramdisk_id='',reservation_id='r-77pb03tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651503421',owner_user_name='tempest-ServersNegativeTestJSON-1651503421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:38Z,user_data=None,user_id='b725deabeb954813950dc1841e6a09fc',uuid=86049569-07b7-43dc-98b9-796174986401,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converting VIF {"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG os_vif [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap921473b6-04, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap921473b6-04, col_values=(('external_ids', {'iface-id': '921473b6-0483-4b8e-9aef-abf159c2337c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:d0:77', 'vm-uuid': '86049569-07b7-43dc-98b9-796174986401'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:40 user nova-compute[73450]: INFO os_vif [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04')
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] No VIF found with MAC fa:16:3e:bd:d0:77, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lazy-loading 'flavor' on Instance uuid 841c9d46-e3ce-4663-9ac0-2d3c1d56711f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.139s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b072306-9518-4be6-8ffc-e0ccb386b330 req-0a5bd961-b638-4c01-a423-70c04da78461 service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:40 user nova-compute[73450]: INFO nova.compute.manager [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Attaching volume a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 to /dev/vdb
Aug 16 16:40:40 user nova-compute[73450]: DEBUG os_brick.utils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0aded-b99d-4b52-8813-365b12658f8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530cf30-5362-46b2-a926-1ab4176be6b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: 57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e65a5f-5e49-4b59-a3b0-362d3cc756d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2948dc-1422-4952-8663-b96d418a4927]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:41 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc7bd8-da2c-43b0-bf11-ad93a2ed68fa]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG os_brick.utils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updating existing volume attachment record: 2d5e598f-44a3-42d0-b18d-935e41b5b53d {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Updated VIF entry in instance network info cache for port 921473b6-0483-4b8e-9aef-abf159c2337c. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Updating instance_info_cache with network_info: [{"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fc98d776-5e21-48a5-810e-9fa093cacc58 req-c0a3c389-51f8-421c-8960-f9b723dd609c service nova] Releasing lock "refresh_cache-86049569-07b7-43dc-98b9-796174986401" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-ef40fde5-d32e-49c2-ae82-2766fa3e40d0. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.network.neutron [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-57bf521b-d547-4c96-891f-ba608307a692. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.network.neutron [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:42 user nova-compute[73450]: INFO nova.compute.manager [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] instance snapshotting
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a05d7ca1-7a9f-49a5-9da3-52583248196a req-c32990bb-8dbe-4c4c-97c5-49413df136b3 service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a05d7ca1-7a9f-49a5-9da3-52583248196a req-c32990bb-8dbe-4c4c-97c5-49413df136b3 service nova] Acquiring lock "86049569-07b7-43dc-98b9-796174986401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a05d7ca1-7a9f-49a5-9da3-52583248196a req-c32990bb-8dbe-4c4c-97c5-49413df136b3 service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a05d7ca1-7a9f-49a5-9da3-52583248196a req-c32990bb-8dbe-4c4c-97c5-49413df136b3 service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a05d7ca1-7a9f-49a5-9da3-52583248196a req-c32990bb-8dbe-4c4c-97c5-49413df136b3 service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] No waiting events found dispatching network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:40:42 user nova-compute[73450]: WARNING nova.compute.manager [req-a05d7ca1-7a9f-49a5-9da3-52583248196a req-c32990bb-8dbe-4c4c-97c5-49413df136b3 service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received unexpected event network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c for instance with vm_state building and task_state spawning.
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.network.neutron [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Beginning live snapshot process
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: 0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.network.neutron [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: 454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92c36674-8653-4914-8458-d7848180f610 req-0a062b4d-2982-4020-8652-4fe43078cf34 service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: 30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204044.349271, 86049569-07b7-43dc-98b9-796174986401 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] VM Resumed (Lifecycle Event)
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Successfully updated port: f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-0350435a-7a63-4ae3-a9b7-0bcfa57646a2. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.network.neutron [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port 0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] Acquiring lock "86049569-07b7-43dc-98b9-796174986401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] No waiting events found dispatching network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:40:44 user nova-compute[73450]: WARNING nova.compute.manager [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received unexpected event network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c for instance with vm_state building and task_state spawning.
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-30202e5f-2595-4bfb-b763-18a1e440f71b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.network.neutron [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json -f qcow2" returned: 0 in 1.534s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 86049569-07b7-43dc-98b9-796174986401] Instance spawned successfully.
Aug 16 16:40:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:40:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7072MB free_disk=24.465103149414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204044.350593, 86049569-07b7-43dc-98b9-796174986401 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] VM Started (Lifecycle Event)
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.network.neutron [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.239s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdobqa9hv/0281a9e4ac0e4cbf986b71ea2e58eab2.delta 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.network.neutron [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Took 7.32 seconds to spawn the instance on the hypervisor.
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdobqa9hv/0281a9e4ac0e4cbf986b71ea2e58eab2.delta 1073741824" returned: 0 in 0.087s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73450) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 16:40:44 user nova-compute[73450]: INFO nova.virt.libvirt.host [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] UEFI support detected
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 841c9d46-e3ce-4663-9ac0-2d3c1d56711f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 42484cde-66d6-4816-962b-912f6df59156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 408dc4d1-cbe3-4c99-b709-1956d987209a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032e6ee8-4545-4867-a8ed-4076ed273174 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 486b238c-d628-47c4-9c94-92639359a3ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance fe1c58b4-aece-4ab9-9979-4351104c23d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 86049569-07b7-43dc-98b9-796174986401 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:40:45 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:40:45 user nova-compute[73450]: INFO nova.compute.manager [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Took 8.46 seconds to build instance.
Aug 16 16:40:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-420a767f-6986-4edd-82d1-920c897d9e3d tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "86049569-07b7-43dc-98b9-796174986401" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.598s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5950a4e4-b1a7-454d-9f51-5f44e9b28cf4 req-c1ddaf61-2fbf-4911-8ecc-27d5a809ec03 service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.845s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-f3121882-5438-4711-bb75-fb4003eb1704. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8ddda5-b9ec-46a3-a147-29a66a6514b4 req-b63182ec-1556-4041-951b-18da40f8df0e service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Successfully updated port: be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:40:46 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdobqa9hv/0281a9e4ac0e4cbf986b71ea2e58eab2.delta /opt/stack/data/nova/instances/snapshots/tmpdobqa9hv/0281a9e4ac0e4cbf986b71ea2e58eab2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:40:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdobqa9hv/0281a9e4ac0e4cbf986b71ea2e58eab2.delta /opt/stack/data/nova/instances/snapshots/tmpdobqa9hv/0281a9e4ac0e4cbf986b71ea2e58eab2" returned: 0 in 0.795s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Snapshot extracted, beginning image upload
Aug 16 16:40:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:40:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:40:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updating instance_info_cache with network_info: [{"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-841c9d46-e3ce-4663-9ac0-2d3c1d56711f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance network_info: |[{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updated VIF entry in instance network info cache for port f3121882-5438-4711-bb75-fb4003eb1704. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aebeb855-5901-47ae-b51d-0693b1025526 req-7b93f2ae-f6cf-4acc-897c-fb704c4c20ed service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:49 user nova-compute[73450]: DEBUG nova.network.neutron [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [{"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance network_info: |[{"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:40:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:40:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updated VIF entry in instance network info cache for port be6d7573-6fa6-4a67-a8d3-2db1b0d2e921. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [{"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0815880f-1f9d-401f-8d87-f1c6e8d2ad02 req-902d4ae4-5e98-4aa2-a745-a8a85142990f service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:40:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:40:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Snapshot image upload complete
Aug 16 16:40:50 user nova-compute[73450]: INFO nova.compute.manager [None req-e187f61e-ce53-485d-9330-cc674adbebac tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Took 7.96 seconds to snapshot the instance on the hypervisor.
Aug 16 16:40:51 user nova-compute[73450]: INFO nova.virt.block_device [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Booting with volume 39a5388f-5cfb-4462-98e0-12a8edb9515b at /dev/vdc
Aug 16 16:40:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[242ff014-2c0c-4403-807f-ab1e83e63a2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db70e6-edcc-4ba8-b7b0-1460d75d2851]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[13da054e-9bf4-42b5-9b4b-c7428232ed25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d0be9e-cc4d-4a86-aa50-9f81a913dd4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:52 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0685ddd-6ba3-4eef-973e-8da7d6243afd]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:52 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating existing volume attachment record: 2651e363-3300-45ce-bf63-6c525c8fa3e7 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:40:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:40:55 user nova-compute[73450]: INFO nova.virt.block_device [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Booting with volume f29ac861-4609-440f-be50-a0e91d3dd122 at /dev/vdc
Aug 16 16:40:56 user nova-compute[73450]: DEBUG os_brick.utils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb214e0d-4cf1-49ba-9d42-c74ad7dece83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8724bb1c-a742-4ba3-a4f1-a550e94334e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc309e3-311b-4d22-8307-418fa55a700f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[030bde77-0111-4691-9e99-de3fb13b6e34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:40:56 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:40:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe5636-1ae2-414b-96e8-697cef83d54a]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG os_brick.utils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:40:56 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating existing volume attachment record: 5aa8ef7d-ad73-457d-8032-c984d688e927 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:41:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-changed-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Refreshing instance network info cache due to event network-changed-69fbeea4-4203-4f15-85a8-5be48915e06d. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:41:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] Acquiring lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] Acquired lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Refreshing network info cache for port 69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:41:01 user nova-compute[73450]: DEBUG nova.network.neutron [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updated VIF entry in instance network info cache for port 69fbeea4-4203-4f15-85a8-5be48915e06d. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:41:01 user nova-compute[73450]: DEBUG nova.network.neutron [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updating instance_info_cache with network_info: [{"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c1bd38cf-1458-4b8f-8531-d0640830b4fc req-3cd9628a-ed8d-49be-bcab-e88188c23836 service nova] Releasing lock "refresh_cache-816ac70d-0ed7-4bf0-ae30-f265f7889221" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lazy-loading 'flavor' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:41:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Creating image(s)
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Ensure instance console log exists: /opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Start _get_guest_xml network_info=[{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c0e63a86-1a89-4efc-b641-8140b47a8e92', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYgnyZLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '486b238c-d628-47c4-9c94-92639359a3ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdfaeaf4-2c7d-4776-b504-93b245d48881', 'serial': 'fdfaeaf4-2c7d-4776-b504-93b245d48881'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '2729be66-9907-4992-bdb0-02c5157202c3', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzANeGUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '486b238c-d628-47c4-9c94-92639359a3ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'febc217e-61dc-4557-afaf-c8fa77d4c888', 'serial': 'febc217e-61dc-4557-afaf-c8fa77d4c888'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '2651e363-3300-45ce-bf63-6c525c8fa3e7', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THEOXpYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '486b238c-d628-47c4-9c94-92639359a3ae', 'attached_at': '', 'detached_at': '', 'volume_id': '39a5388f-5cfb-4462-98e0-12a8edb9515b', 'serial': '39a5388f-5cfb-4462-98e0-12a8edb9515b'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:41:04 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:41:04 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYgnyZLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:04 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:04 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:04 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3e848-0906-48d5-9fc7-c155778edb5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:04 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e117d93-c426-407a-9248-7bf6c47914fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881] added
Aug 16 16:41:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edec8fd-6abf-4eca-9fa3-e8fe39e99308]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ByFvlsEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:04 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1259b2f7-f583-4e3a-90a1-a13a844ca4a5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYgnyZLD {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:04 user nova-compute[73450]: INFO nova.compute.manager [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Attaching volume 47d547c8-f48c-4a3f-9e14-11afafaf2464 to /dev/vdb
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYgnyZLD" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c7bd69-dc82-45d9-9bcb-8556c2bf14b0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYgnyZLD'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb782185-f868-480d-b80a-454aa0f07ca5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e638b9e-e4e9-401d-843e-ae046b43a0ed]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.utils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbcbc06-0f5e-4969-bc39-c0862c2b334a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260]
Aug 16 16:41:04 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf469b-001e-4305-9651-bd3765cee340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a49a19-4da6-4db7-ba88-df1bb8b59e59]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b4689b-9bde-4062-87fb-413d69003627]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44773cf6-641f-49a4-9334-f1364a77d945]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:04 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:04 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[744ff921-5c6c-405b-82e2-e41463ce9e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dabf11-44ad-4404-b277-1661f8c5b33c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8233fbc-a18d-40a7-b822-599c5f599b2d]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYgnyZLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:04 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:41:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9ac0a-724d-4d9c-aea0-a7641220cf7a]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG os_brick.utils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:04 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updating existing volume attachment record: d43db83a-2554-4b1b-9ae1-8af83ca3a592 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23961343432623130', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961343432623130', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.260s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:05 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab491354-06f2-4559-8729-20f4ab86409a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:05 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzANeGUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca1f5d-0e56-416b-983b-80d5b0050e5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1] added
Aug 16 16:41:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aaa7f1-eccb-4e3e-b3d8-b4b8c2048df2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd617df4-6beb-45b4-93e7-654e7cd16f8e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ByFvlsEG {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ByFvlsEG" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d243581-c4a0-4e5c-901d-20826b6ad64a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ByFvlsEG'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4b2c2d-6e09-43df-8fb6-fae5c40d2fac]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d409dc-505f-4966-ad7a-a6efc14dfa2e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2e74c-2df6-4e77-9bf4-0653c21f9188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260]
Aug 16 16:41:05 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5349307-9b56-466a-8bfe-d15f1e2a683f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-changed-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Refreshing instance network info cache due to event network-changed-10450674-e9c9-447e-b1ab-d53f226dae29. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] Acquiring lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] Acquired lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG nova.network.neutron [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Refreshing network info cache for port 10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc1a21c-13eb-4195-83f7-8f49abc50c65]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[648eaae2-4b84-4dcf-abf0-2fac4018fed4]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ByFvlsEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG nova.network.neutron [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updated VIF entry in instance network info cache for port 10450674-e9c9-447e-b1ab-d53f226dae29. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG nova.network.neutron [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating instance_info_cache with network_info: [{"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1d710f9b-fc47-4dc2-ba02-6b6425a932d9 req-1a1e03a9-f479-4bc1-985c-f1ae2ee4cd39 service nova] Releasing lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] <== connect_volume: return (2611ms) {'type': 'block', 'scsi_wwn': '26630343164663961', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630343164663961', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.319s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:06 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:06 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lazy-loading 'flavor' on Instance uuid 841c9d46-e3ce-4663-9ac0-2d3c1d56711f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1db551-c77f-4d70-af9a-6652ca5f62c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:06 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:41:06 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:06 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:41:06 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:06 user nova-compute[73450]:   <serial>a1f3161c-671e-4b41-98dd-1d3ad20bd2f1</serial>
Aug 16 16:41:06 user nova-compute[73450]: </disk>
Aug 16 16:41:06 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c29b2b-6012-4916-aa40-33efcb810dc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888] added
Aug 16 16:41:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dab8a3-0174-4284-b98c-129a8565829f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aea235-7e02-4343-95a7-61b1131bea79]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzANeGUr {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzANeGUr" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4dd64c-d986-4f08-b9dd-5fe95246ceab]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzANeGUr'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38407c96-6e8e-4f8b-ac93-d371fec92a23]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a11e8c-7568-4e4f-b72f-25f1a64129e5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5dbcb-7c35-4793-9a12-a65f3cd53718]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260]
Aug 16 16:41:07 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530ac9c-6856-4265-b420-55d47eef1242]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d8524-c52a-4856-a46b-861774495a84]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92d82bc-8fc9-430c-9ab2-30b7103f9789]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzANeGUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] No VIF found with MAC fa:16:3e:84:b7:80, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cc2c802b-ddff-4ee6-8400-cccee6e62c80 tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.777s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== connect_volume: return (2666ms) {'type': 'block', 'scsi_wwn': '23336616566353237', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336616566353237', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THEOXpYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:08 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:08 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:08 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[023db5fc-e4fa-455e-aa57-0dfb5380f9af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:08 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b5c11-ed22-483a-9d8f-d59cf7690098]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b] added
Aug 16 16:41:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c450281-c781-4be3-97f8-2a9e30bef28e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bbdc2b-f585-4e3f-9a22-9edcb8266bb4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THEOXpYi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THEOXpYi" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[887ec4b7-88aa-4dd2-9a92-8723ff33786e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THEOXpYi'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7d11f-cb27-4c1d-9135-77a3f2e6093c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cff084c-3da8-4338-97b8-d291d0d52d12]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7114822-8864-41a9-b691-56f466d1e1ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260]
Aug 16 16:41:08 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7055107-2b6c-4e77-be51-03b9af437679]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[109cef30-a483-4c37-8ecf-7fdfeafdbd27]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:08 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d0151b-39ca-43f3-9ea8-a581d4bbd500]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THEOXpYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:08 user nova-compute[73450]: INFO nova.compute.manager [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Terminating instance
Aug 16 16:41:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-4f30bb48-26b7-4827-b3d6-89ac14946b07 req-b35e842a-02a8-48d0-b1e7-4cbd61892897 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-vif-unplugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4f30bb48-26b7-4827-b3d6-89ac14946b07 req-b35e842a-02a8-48d0-b1e7-4cbd61892897 service nova] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4f30bb48-26b7-4827-b3d6-89ac14946b07 req-b35e842a-02a8-48d0-b1e7-4cbd61892897 service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4f30bb48-26b7-4827-b3d6-89ac14946b07 req-b35e842a-02a8-48d0-b1e7-4cbd61892897 service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-4f30bb48-26b7-4827-b3d6-89ac14946b07 req-b35e842a-02a8-48d0-b1e7-4cbd61892897 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] No waiting events found dispatching network-vif-unplugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-4f30bb48-26b7-4827-b3d6-89ac14946b07 req-b35e842a-02a8-48d0-b1e7-4cbd61892897 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-vif-unplugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:41:09 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Instance destroyed successfully.
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.objects.instance [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lazy-loading 'resources' on Instance uuid 841c9d46-e3ce-4663-9ac0-2d3c1d56711f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1936032143',display_name='tempest-DeleteServersTestJSON-server-1936032143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1936032143',id=2,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7edfc2caee59458eaf48af23248bfdc1',ramdisk_id='',reservation_id='r-5cf7el7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-759361170',owner_user_name='tempest-DeleteServersTestJSON-759361170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:06Z,user_data=None,user_id='9979e5fda67540db87b360224958bdb9',uuid=841c9d46-e3ce-4663-9ac0-2d3c1d56711f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Converting VIF {"id": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "address": "fa:16:3e:84:b7:80", "network": {"id": "ac9629ed-d017-4fb7-9b1e-942143f0b404", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-751913150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edfc2caee59458eaf48af23248bfdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ad8621-0f", "ovs_interfaceid": "12ad8621-0f8e-43d2-8fa8-87aa589ac9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_vif [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12ad8621-0f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:09 user nova-compute[73450]: INFO os_vif [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:b7:80,bridge_name='br-int',has_traffic_filtering=True,id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb,network=Network(ac9629ed-d017-4fb7-9b1e-942143f0b404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ad8621-0f')
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ByFvlsEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:09 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23938383031386564', 'path': '/dev/sdf'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938383031386564', 'path': '/dev/sdf'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.105s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[270850df-5e45-4a38-a118-d1abe1ae5a04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lazy-loading 'pci_devices' on Instance uuid 486b238c-d628-47c4-9c94-92639359a3ae {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd78b56-9075-46d2-bd59-d7859d182a70]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:09 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270746290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:41:09 user nova-compute[73450]:   <uuid>486b238c-d628-47c4-9c94-92639359a3ae</uuid>
Aug 16 16:41:09 user nova-compute[73450]:   <name>instance-0000000a</name>
Aug 16 16:41:09 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:41:09 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:41:09 user nova-compute[73450]:   <metadata>
Aug 16 16:41:09 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:09 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:41:09 user nova-compute[73450]:       <nova:name>tempest-device-tagging-server-56842240</nova:name>
Aug 16 16:41:09 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:41:04</nova:creationTime>
Aug 16 16:41:09 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:41:09 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:09 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:41:09 user nova-compute[73450]:       <nova:owner>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:user uuid="1e35928713fb435bafccc4978bc144a9">tempest-TaggedBootDevicesTest-821495231-project-member</nova:user>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:project uuid="9eb0646d9317488a81d54378cbe49855">tempest-TaggedBootDevicesTest-821495231</nova:project>
Aug 16 16:41:09 user nova-compute[73450]:       </nova:owner>
Aug 16 16:41:09 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:09 user nova-compute[73450]:       <nova:ports>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="53fe6daa-d147-4155-b9dd-089e4348294a">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="629248db-6c03-48d6-b25a-522627171671">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.58" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="37132e00-2ad0-42c5-95a0-229b165d7d31">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="168798cb-2ee6-4d82-b564-0b62cd5734f2">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="ef40fde5-d32e-49c2-ae82-2766fa3e40d0">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="0350435a-7a63-4ae3-a9b7-0bcfa57646a2">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:         <nova:port uuid="f3121882-5438-4711-bb75-fb4003eb1704">
Aug 16 16:41:09 user nova-compute[73450]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 16:41:09 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:09 user nova-compute[73450]:       </nova:ports>
Aug 16 16:41:09 user nova-compute[73450]:     </nova:instance>
Aug 16 16:41:09 user nova-compute[73450]:   </metadata>
Aug 16 16:41:09 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:41:09 user nova-compute[73450]:     <system>
Aug 16 16:41:09 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:41:09 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:41:09 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:41:09 user nova-compute[73450]:       <entry name="serial">486b238c-d628-47c4-9c94-92639359a3ae</entry>
Aug 16 16:41:09 user nova-compute[73450]:       <entry name="uuid">486b238c-d628-47c4-9c94-92639359a3ae</entry>
Aug 16 16:41:09 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:41:09 user nova-compute[73450]:     </system>
Aug 16 16:41:09 user nova-compute[73450]:   </sysinfo>
Aug 16 16:41:09 user nova-compute[73450]:   <os>
Aug 16 16:41:09 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:41:09 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:41:09 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:41:09 user nova-compute[73450]:   </os>
Aug 16 16:41:09 user nova-compute[73450]:   <features>
Aug 16 16:41:09 user nova-compute[73450]:     <acpi/>
Aug 16 16:41:09 user nova-compute[73450]:     <apic/>
Aug 16 16:41:09 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:41:09 user nova-compute[73450]:   </features>
Aug 16 16:41:09 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:41:09 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:41:09 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:41:09 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:41:09 user nova-compute[73450]:   </clock>
Aug 16 16:41:09 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:41:09 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:41:09 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:41:09 user nova-compute[73450]:   </cpu>
Aug 16 16:41:09 user nova-compute[73450]:   <devices>
Aug 16 16:41:09 user nova-compute[73450]:     <disk type="file" device="cdrom">
Aug 16 16:41:09 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 16:41:09 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae/disk.config"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="hda" bus="ide"/>
Aug 16 16:41:09 user nova-compute[73450]:     </disk>
Aug 16 16:41:09 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:41:09 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:09 user nova-compute[73450]:       <source dev="/dev/sdc"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <serial>fdfaeaf4-2c7d-4776-b504-93b245d48881</serial>
Aug 16 16:41:09 user nova-compute[73450]:     </disk>
Aug 16 16:41:09 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:41:09 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:09 user nova-compute[73450]:       <source dev="/dev/sde"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <serial>febc217e-61dc-4557-afaf-c8fa77d4c888</serial>
Aug 16 16:41:09 user nova-compute[73450]:     </disk>
Aug 16 16:41:09 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:41:09 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:09 user nova-compute[73450]:       <source dev="/dev/sdf"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="vdc" bus="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <serial>39a5388f-5cfb-4462-98e0-12a8edb9515b</serial>
Aug 16 16:41:09 user nova-compute[73450]:     </disk>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:f7:4e:83"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tap53fe6daa-d1"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:c7:59:86"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tap629248db-6c"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:d0:61:4f"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tap37132e00-2a"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:76:cf:a3"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tap168798cb-2e"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:26:d2:73"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tapef40fde5-d3"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:cc:28:90"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tap0350435a-7a"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:09 user nova-compute[73450]:       <mac address="fa:16:3e:b7:c0:31"/>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:09 user nova-compute[73450]:       <target dev="tapf3121882-54"/>
Aug 16 16:41:09 user nova-compute[73450]:     </interface>
Aug 16 16:41:09 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:41:09 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae/console.log" append="off"/>
Aug 16 16:41:09 user nova-compute[73450]:     </serial>
Aug 16 16:41:09 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:41:09 user nova-compute[73450]:     <video>
Aug 16 16:41:09 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:09 user nova-compute[73450]:     </video>
Aug 16 16:41:09 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:41:09 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:41:09 user nova-compute[73450]:     </rng>
Aug 16 16:41:09 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:41:09 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:41:09 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:41:09 user nova-compute[73450]:     </memballoon>
Aug 16 16:41:09 user nova-compute[73450]:   </devices>
Aug 16 16:41:09 user nova-compute[73450]: </domain>
Aug 16 16:41:09 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53fe6daa-d1, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53fe6daa-d1, col_values=(('external_ids', {'iface-id': '53fe6daa-d147-4155-b9dd-089e4348294a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:4e:83', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1658cf-0d6c-43e2-b1d2-e0b702075183]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1')
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap629248db-6c, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap629248db-6c, col_values=(('external_ids', {'iface-id': '629248db-6c03-48d6-b25a-522627171671', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:59:86', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3290ba-0f13-4e9a-8f8d-208fd34a5736]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c')
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485d647-1054-4af3-b098-e934cf022c64]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37132e00-2a, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37132e00-2a, col_values=(('external_ids', {'iface-id': '37132e00-2ad0-42c5-95a0-229b165d7d31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:61:4f', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a2502-665d-44a3-b8ad-81b8348aded5]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a')
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap168798cb-2e, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap168798cb-2e, col_values=(('external_ids', {'iface-id': '168798cb-2ee6-4d82-b564-0b62cd5734f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:cf:a3', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efeb2cc-11a6-4399-a76d-53999df9c5be]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e')
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef40fde5-d3, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef40fde5-d3, col_values=(('external_ids', {'iface-id': 'ef40fde5-d32e-49c2-ae82-2766fa3e40d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:d2:73', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[31689a80-45ab-4a4d-8b2e-fface1a3c207]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260]
Aug 16 16:41:09 user nova-compute[73450]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f3161c-671e-4b41-98dd-1d3ad20bd2f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3e86b4-f17e-4f63-89a1-b7b8f1baf515]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] <== disconnect_volume: return (435ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:41:09 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Deleting instance files /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f_del
Aug 16 16:41:09 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Deletion of /opt/stack/data/nova/instances/841c9d46-e3ce-4663-9ac0-2d3c1d56711f_del complete
Aug 16 16:41:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:09 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3')
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:09 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0350435a-7a, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0350435a-7a, col_values=(('external_ids', {'iface-id': '0350435a-7a63-4ae3-a9b7-0bcfa57646a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:28:90', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:10 user nova-compute[73450]: INFO nova.compute.manager [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 16 16:41:10 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a')
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3121882-54, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3121882-54, col_values=(('external_ids', {'iface-id': 'f3121882-5438-4711-bb75-fb4003eb1704', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:c0:31', 'vm-uuid': '486b238c-d628-47c4-9c94-92639359a3ae'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:10 user nova-compute[73450]: INFO os_vif [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54')
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] No BDM found with device name hda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] No VIF found with MAC fa:16:3e:f7:4e:83, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] No VIF found with MAC fa:16:3e:26:d2:73, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Using config drive
Aug 16 16:41:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Creating config drive at /opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae/disk.config
Aug 16 16:41:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1bi8fq7d {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.objects.instance [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'flavor' on Instance uuid 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1bi8fq7d" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:10 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:10 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Took 0.93 seconds to deallocate network for instance.
Aug 16 16:41:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-0967e7a5-341d-4fac-b0c9-4f252e7cdd1d req-b09f98cb-24c9-4249-84cf-2503ab66e99a service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-vif-deleted-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:11 user nova-compute[73450]: INFO nova.compute.manager [req-0967e7a5-341d-4fac-b0c9-4f252e7cdd1d req-b09f98cb-24c9-4249-84cf-2503ab66e99a service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Neutron deleted interface 12ad8621-0f8e-43d2-8fa8-87aa589ac9cb; detaching it from the instance and deleting it from the info cache
Aug 16 16:41:11 user nova-compute[73450]: DEBUG nova.network.neutron [req-0967e7a5-341d-4fac-b0c9-4f252e7cdd1d req-b09f98cb-24c9-4249-84cf-2503ab66e99a service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-0967e7a5-341d-4fac-b0c9-4f252e7cdd1d req-b09f98cb-24c9-4249-84cf-2503ab66e99a service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Detach interface failed, port_id=12ad8621-0f8e-43d2-8fa8-87aa589ac9cb, reason: Instance 841c9d46-e3ce-4663-9ac0-2d3c1d56711f could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:11 user nova-compute[73450]: INFO nova.compute.manager [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Attaching volume 18654112-79cd-401e-ad9a-2bbe63a03ced to /dev/vdb
Aug 16 16:41:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-30c81b27-a764-47b0-8e7b-1a4e4a12af8a req-98b5c996-1e0c-469a-ba5e-25135ed79d51 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received event network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-30c81b27-a764-47b0-8e7b-1a4e4a12af8a req-98b5c996-1e0c-469a-ba5e-25135ed79d51 service nova] Acquiring lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-30c81b27-a764-47b0-8e7b-1a4e4a12af8a req-98b5c996-1e0c-469a-ba5e-25135ed79d51 service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-30c81b27-a764-47b0-8e7b-1a4e4a12af8a req-98b5c996-1e0c-469a-ba5e-25135ed79d51 service nova] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-30c81b27-a764-47b0-8e7b-1a4e4a12af8a req-98b5c996-1e0c-469a-ba5e-25135ed79d51 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] No waiting events found dispatching network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:11 user nova-compute[73450]: WARNING nova.compute.manager [req-30c81b27-a764-47b0-8e7b-1a4e4a12af8a req-98b5c996-1e0c-469a-ba5e-25135ed79d51 service nova] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Received unexpected event network-vif-plugged-12ad8621-0f8e-43d2-8fa8-87aa589ac9cb for instance with vm_state active and task_state deleting.
Aug 16 16:41:11 user nova-compute[73450]: INFO nova.compute.manager [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Took 0.83 seconds to detach 1 volumes for instance.
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:11 user nova-compute[73450]: DEBUG os_brick.utils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f83cbd-f449-46a5-b668-60aa447d57f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[76865e0d-0f73-4911-9165-b30d55e60ad4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d562e2-41da-41be-a9bc-07addf1d5b8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[80347849-cd7d-4ec2-ae01-cf31f59741f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:12 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a39b6-7d28-4143-92ae-522ec9b75df3]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG os_brick.utils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating existing volume attachment record: f9b031ae-fd94-4a1e-9650-79f1017ec039 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:12 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Deleted allocations for instance 841c9d46-e3ce-4663-9ac0-2d3c1d56711f
Aug 16 16:41:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-53f5017a-6e44-4247-866a-7f00bc7e6c2f tempest-DeleteServersTestJSON-759361170 tempest-DeleteServersTestJSON-759361170-project-member] Lock "841c9d46-e3ce-4663-9ac0-2d3c1d56711f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.915s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-9cc750ee-30ef-4847-a99b-f5833bbc38a9 req-dc55956a-e8cb-4cd1-82ed-e5ba7cf2d88b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9cc750ee-30ef-4847-a99b-f5833bbc38a9 req-dc55956a-e8cb-4cd1-82ed-e5ba7cf2d88b service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9cc750ee-30ef-4847-a99b-f5833bbc38a9 req-dc55956a-e8cb-4cd1-82ed-e5ba7cf2d88b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9cc750ee-30ef-4847-a99b-f5833bbc38a9 req-dc55956a-e8cb-4cd1-82ed-e5ba7cf2d88b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-9cc750ee-30ef-4847-a99b-f5833bbc38a9 req-dc55956a-e8cb-4cd1-82ed-e5ba7cf2d88b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:13 user nova-compute[73450]: WARNING nova.compute.manager [req-9cc750ee-30ef-4847-a99b-f5833bbc38a9 req-dc55956a-e8cb-4cd1-82ed-e5ba7cf2d88b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 for instance with vm_state building and task_state spawning.
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:13 user nova-compute[73450]: WARNING nova.compute.manager [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a for instance with vm_state building and task_state spawning.
Aug 16 16:41:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:13 user nova-compute[73450]: WARNING nova.compute.manager [req-77b76ff6-d58f-4a6a-bb29-5614ac348e5d req-5897f2d8-bc71-4638-bf56-38b4140ee466 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a for instance with vm_state building and task_state spawning.
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bdc8fb6-3f1e-4638-bad9-d081511beee4 req-45f0058c-0a64-49c0-a1b1-53bb5054d886 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bdc8fb6-3f1e-4638-bad9-d081511beee4 req-45f0058c-0a64-49c0-a1b1-53bb5054d886 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bdc8fb6-3f1e-4638-bad9-d081511beee4 req-45f0058c-0a64-49c0-a1b1-53bb5054d886 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bdc8fb6-3f1e-4638-bad9-d081511beee4 req-45f0058c-0a64-49c0-a1b1-53bb5054d886 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bdc8fb6-3f1e-4638-bad9-d081511beee4 req-45f0058c-0a64-49c0-a1b1-53bb5054d886 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:14 user nova-compute[73450]: WARNING nova.compute.manager [req-2bdc8fb6-3f1e-4638-bad9-d081511beee4 req-45f0058c-0a64-49c0-a1b1-53bb5054d886 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 for instance with vm_state building and task_state spawning.
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:15 user nova-compute[73450]: WARNING nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 for instance with vm_state building and task_state spawning.
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:15 user nova-compute[73450]: WARNING nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 for instance with vm_state building and task_state spawning.
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:15 user nova-compute[73450]: WARNING nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 for instance with vm_state building and task_state spawning.
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:15 user nova-compute[73450]: WARNING nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 for instance with vm_state building and task_state spawning.
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:15 user nova-compute[73450]: WARNING nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 for instance with vm_state building and task_state spawning.
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:15 user nova-compute[73450]: WARNING nova.compute.manager [req-a8e94945-4b7b-495e-80ab-989dccc404ba req-8ce14762-6a1f-4527-95b3-acac3f697aa2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 for instance with vm_state building and task_state spawning.
Aug 16 16:41:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-f6a67def-f5cd-42eb-a554-e1f42e544c1f req-767b92da-7b33-4c67-a31f-e18a5960193a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f6a67def-f5cd-42eb-a554-e1f42e544c1f req-767b92da-7b33-4c67-a31f-e18a5960193a service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f6a67def-f5cd-42eb-a554-e1f42e544c1f req-767b92da-7b33-4c67-a31f-e18a5960193a service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f6a67def-f5cd-42eb-a554-e1f42e544c1f req-767b92da-7b33-4c67-a31f-e18a5960193a service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-f6a67def-f5cd-42eb-a554-e1f42e544c1f req-767b92da-7b33-4c67-a31f-e18a5960193a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:16 user nova-compute[73450]: WARNING nova.compute.manager [req-f6a67def-f5cd-42eb-a554-e1f42e544c1f req-767b92da-7b33-4c67-a31f-e18a5960193a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 for instance with vm_state building and task_state spawning.
Aug 16 16:41:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a4761f0f-a958-47f1-bbc0-b248843f0928 req-05ebc384-88c1-4031-b063-a045c15b3f0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a4761f0f-a958-47f1-bbc0-b248843f0928 req-05ebc384-88c1-4031-b063-a045c15b3f0e service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a4761f0f-a958-47f1-bbc0-b248843f0928 req-05ebc384-88c1-4031-b063-a045c15b3f0e service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a4761f0f-a958-47f1-bbc0-b248843f0928 req-05ebc384-88c1-4031-b063-a045c15b3f0e service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a4761f0f-a958-47f1-bbc0-b248843f0928 req-05ebc384-88c1-4031-b063-a045c15b3f0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:16 user nova-compute[73450]: WARNING nova.compute.manager [req-a4761f0f-a958-47f1-bbc0-b248843f0928 req-05ebc384-88c1-4031-b063-a045c15b3f0e service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 for instance with vm_state building and task_state spawning.
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204077.3301833, 486b238c-d628-47c4-9c94-92639359a3ae => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] VM Resumed (Lifecycle Event)
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance spawned successfully.
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-b15504e3-dc81-4a8c-a5f1-694065770d61 req-a611548f-2f16-4a0c-b752-79130981778c service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b15504e3-dc81-4a8c-a5f1-694065770d61 req-a611548f-2f16-4a0c-b752-79130981778c service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b15504e3-dc81-4a8c-a5f1-694065770d61 req-a611548f-2f16-4a0c-b752-79130981778c service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b15504e3-dc81-4a8c-a5f1-694065770d61 req-a611548f-2f16-4a0c-b752-79130981778c service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-b15504e3-dc81-4a8c-a5f1-694065770d61 req-a611548f-2f16-4a0c-b752-79130981778c service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:17 user nova-compute[73450]: WARNING nova.compute.manager [req-b15504e3-dc81-4a8c-a5f1-694065770d61 req-a611548f-2f16-4a0c-b752-79130981778c service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 for instance with vm_state building and task_state spawning.
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204077.330317, 486b238c-d628-47c4-9c94-92639359a3ae => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] VM Started (Lifecycle Event)
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Took 13.47 seconds to spawn the instance on the hypervisor.
Aug 16 16:41:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:17 user nova-compute[73450]: INFO nova.compute.manager [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Took 52.60 seconds to build instance.
Aug 16 16:41:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f2ba4606-c6a2-4ffe-9f65-44d2da79118a tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "486b238c-d628-47c4-9c94-92639359a3ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.704s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-changed-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Refreshing instance network info cache due to event network-changed-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] Acquiring lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] Acquired lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Refreshing network info cache for port ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "interface-408dc4d1-cbe3-4c99-b709-1956d987209a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "interface-408dc4d1-cbe3-4c99-b709-1956d987209a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'flavor' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'pci_requests' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updated VIF entry in instance network info cache for port ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating instance_info_cache with network_info: [{"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] Releasing lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:18 user nova-compute[73450]: WARNING nova.compute.manager [req-d795ea93-3e5e-4482-a87c-9153c8c41050 req-b48b7b79-6816-42b4-8699-bea091b69339 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 for instance with vm_state active and task_state None.
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.policy [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9fbb80fe4c4693b017e36230b65e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aeededc22ac49fe953a06bc61cb0fec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-changed-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Refreshing instance network info cache due to event network-changed-28373f47-5f2f-4c07-8188-7b3edb9cc645. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] Acquiring lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] Acquired lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Refreshing network info cache for port 28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:41:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Successfully created port: 29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:41:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updated VIF entry in instance network info cache for port 28373f47-5f2f-4c07-8188-7b3edb9cc645. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:41:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-78f8679f-79ac-4a27-967d-bf6910d3d4a7 req-f2d8f166-e386-48cc-bee4-0087b6149310 service nova] Releasing lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Successfully updated port: 29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquired lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-changed-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Refreshing instance network info cache due to event network-changed-29b80381-cce8-4301-8960-d836347f6f35. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] Acquiring lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG nova.objects.instance [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lazy-loading 'flavor' on Instance uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:41:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Creating image(s)
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Ensure instance console log exists: /opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Start _get_guest_xml network_info=[{"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '84ac85cb-6a5a-451f-bb38-173c42e97dba', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsgUDfRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe1c58b4-aece-4ab9-9979-4351104c23d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb40c827-8f1a-445f-8b20-6fb2ed049953', 'serial': 'fb40c827-8f1a-445f-8b20-6fb2ed049953'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'c05f3be4-2179-4ec8-b4c0-6f43fb6b86cd', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DahqsHwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe1c58b4-aece-4ab9-9979-4351104c23d4', 'attached_at': '', 'detached_at': '', 'volume_id': '4a0a8458-6cc7-4561-8a21-615d26598e45', 'serial': '4a0a8458-6cc7-4561-8a21-615d26598e45'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '5aa8ef7d-ad73-457d-8032-c984d688e927', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PygMGkdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe1c58b4-aece-4ab9-9979-4351104c23d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'f29ac861-4609-440f-be50-a0e91d3dd122', 'serial': 'f29ac861-4609-440f-be50-a0e91d3dd122'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:41:21 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:41:21 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsgUDfRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:21 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:21 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:21 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a231661-16d7-46a3-9cc8-e329fd826742]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:21 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:21 user nova-compute[73450]: INFO nova.compute.manager [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Attaching volume 44f5ea9e-edc6-47a3-be04-30326a9f5b73 to /dev/vdb
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[298201bf-ee41-42cc-8f31-e530566f9d65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953] added
Aug 16 16:41:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[061a21e2-89e4-4708-8e6d-667a9a797a5f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd4296-3c25-4ba4-97ef-3e906a7f05d9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsgUDfRp {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.utils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsgUDfRp" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb31347f-4435-4f8b-aeba-454e97ac23b4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZsgUDfRp'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf99287-6b2d-4a03-a7a7-36a405038f9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40917e6-4bb3-4192-9c1d-d1e7f4e0d145]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae9a1a-de95-4f20-ae3a-5f6b68190b45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a542c9-2da9-44f8-b52f-6801a5040cc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44c9187-add0-47e7-8a5a-393a2025c4c1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[219df414-91b1-4cef-bb5e-e3824a9b5e3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Releasing lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] Acquired lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.network.neutron [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Refreshing network info cache for port 29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_vif [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:21 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc958d17-58be-4785-8083-04a76478bc08]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aad94d-dd84-4782-afe8-08f3d8d8ce04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.utils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating existing volume attachment record: 878e7f21-f47d-4b02-9793-de2cbeec2efb {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260]
Aug 16 16:41:21 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29b80381-cc, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29b80381-cc, col_values=(('external_ids', {'iface-id': '29b80381-cce8-4301-8960-d836347f6f35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:7f:07', 'vm-uuid': '408dc4d1-cbe3-4c99-b709-1956d987209a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: INFO os_vif [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc')
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] attach device xml: <interface type="ethernet">
Aug 16 16:41:21 user nova-compute[73450]:   <mac address="fa:16:3e:f1:7f:07"/>
Aug 16 16:41:21 user nova-compute[73450]:   <model type="virtio"/>
Aug 16 16:41:21 user nova-compute[73450]:   <mtu size="1442"/>
Aug 16 16:41:21 user nova-compute[73450]:   <target dev="tap29b80381-cc"/>
Aug 16 16:41:21 user nova-compute[73450]: </interface>
Aug 16 16:41:21 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed344d2f-0f13-4ea8-87f2-c6d4e3b9b65b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7483fc7b-a6e9-41bf-859d-23e3f8ce1b13]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:21 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[173584de-e0af-461e-befd-91963d0dac4f]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsgUDfRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-e866b1cc-e701-4c77-bb3d-560b80622a82 req-b25c1e6e-36d9-40f3-98de-6aa375b5e1a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e866b1cc-e701-4c77-bb3d-560b80622a82 req-b25c1e6e-36d9-40f3-98de-6aa375b5e1a4 service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e866b1cc-e701-4c77-bb3d-560b80622a82 req-b25c1e6e-36d9-40f3-98de-6aa375b5e1a4 service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e866b1cc-e701-4c77-bb3d-560b80622a82 req-b25c1e6e-36d9-40f3-98de-6aa375b5e1a4 service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-e866b1cc-e701-4c77-bb3d-560b80622a82 req-b25c1e6e-36d9-40f3-98de-6aa375b5e1a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:21 user nova-compute[73450]: WARNING nova.compute.manager [req-e866b1cc-e701-4c77-bb3d-560b80622a82 req-b25c1e6e-36d9-40f3-98de-6aa375b5e1a4 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 for instance with vm_state active and task_state None.
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No BDM found with device name hda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No VIF found with MAC fa:16:3e:83:79:d8, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:21 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:21 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:21 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:21</nova:creationTime>
Aug 16 16:41:21 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:21 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:21 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:21 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:21 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:21 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:21 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:21 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:21 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:21 user nova-compute[73450]:     <nova:port uuid="29b80381-cce8-4301-8960-d836347f6f35">
Aug 16 16:41:21 user nova-compute[73450]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 16 16:41:21 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:21 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:21 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:21 user nova-compute[73450]:  {{(pid=73450) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f579ecc-fb94-4443-bcc6-e0fbf6d01fa5 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "interface-408dc4d1-cbe3-4c99-b709-1956d987209a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.538s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updated VIF entry in instance network info cache for port 29b80381-cce8-4301-8960-d836347f6f35. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2949c295-7d6b-4a5f-b7a0-51ae4ed96f4f req-92e8350b-e954-4a60-8757-9370aa79540d service nova] Releasing lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '26162376230343636', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162376230343636', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DahqsHwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:22 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:22 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:22 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94d499-8db6-4a23-ab1c-57c9be7dc830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:22 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e27c18-19de-4e1c-aa38-2328ebb569f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45] added
Aug 16 16:41:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa41da-34ba-4bf3-8247-a4e86e11cce1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e5a689-6b9e-4af1-abf4-dfab8bf0ebe5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DahqsHwk {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DahqsHwk" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0b3be-05f3-472c-95f7-20d85b4378fd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DahqsHwk'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[27789379-baf6-4d51-bbf9-769a8e929ec9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e087cd5b-62eb-4cbe-92b3-7315cb313287]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[80491277-3d2e-43f8-a93b-3da2bc4c2541]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260]
Aug 16 16:41:22 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e000e2-4a30-45fa-b82a-c74fd7db7021]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02710dc-96ad-4aab-949a-c58cd1d73007]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f06bbf4-b7d4-41d7-b6d7-dcd75e0df2d6]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:22 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-e1839afd-07a3-406c-a6b6-d244902d08d8 req-626d7509-6e84-4bda-9b8b-ca67e554b26b service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e1839afd-07a3-406c-a6b6-d244902d08d8 req-626d7509-6e84-4bda-9b8b-ca67e554b26b service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e1839afd-07a3-406c-a6b6-d244902d08d8 req-626d7509-6e84-4bda-9b8b-ca67e554b26b service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e1839afd-07a3-406c-a6b6-d244902d08d8 req-626d7509-6e84-4bda-9b8b-ca67e554b26b service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-e1839afd-07a3-406c-a6b6-d244902d08d8 req-626d7509-6e84-4bda-9b8b-ca67e554b26b service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:23 user nova-compute[73450]: WARNING nova.compute.manager [req-e1839afd-07a3-406c-a6b6-d244902d08d8 req-626d7509-6e84-4bda-9b8b-ca67e554b26b service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 for instance with vm_state active and task_state None.
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DahqsHwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23936323065383363', 'path': '/dev/sdg'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936323065383363', 'path': '/dev/sdg'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PygMGkdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:23 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:23 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:23 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d580850d-47dd-4e75-b64d-8e5f7dfa2fc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:24 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e0cb4f-f536-4b56-a05f-1d1adbf8ac47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122] added
Aug 16 16:41:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133e13d-4308-4c51-9e1e-a42f9f4ae52a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7107eb-ce38-45ad-9f2c-9c5d7df27144]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PygMGkdp {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PygMGkdp" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4cd6df-a2cb-41b7-a62d-eb987ad25b70]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PygMGkdp'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a98e7b-46d5-424a-94cc-82fe6c63ee50]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b47514-03c8-457f-a9a6-e62cfca878f7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[100d29da-a8b8-4901-8dfa-2ddfe435d4ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260]
Aug 16 16:41:24 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c11778b-f032-4211-be67-e15c7b7ed3c9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0471c4-3b96-40a8-a53f-c4937c75ba3c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a982f243-04c6-4d9b-b72b-a464f0580862]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PygMGkdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:24 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204069.496684, 841c9d46-e3ce-4663-9ac0-2d3c1d56711f => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:41:24 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] VM Stopped (Lifecycle Event)
Aug 16 16:41:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4fc61007-9fa4-417b-a4a0-b8c22deb7552 None None] [instance: 841c9d46-e3ce-4663-9ac0-2d3c1d56711f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23232333963316637', 'path': '/dev/sdh'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232333963316637', 'path': '/dev/sdh'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lazy-loading 'pci_devices' on Instance uuid fe1c58b4-aece-4ab9-9979-4351104c23d4 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:41:25 user nova-compute[73450]:   <uuid>fe1c58b4-aece-4ab9-9979-4351104c23d4</uuid>
Aug 16 16:41:25 user nova-compute[73450]:   <name>instance-0000000b</name>
Aug 16 16:41:25 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:41:25 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:41:25 user nova-compute[73450]:   <metadata>
Aug 16 16:41:25 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:25 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:41:25 user nova-compute[73450]:       <nova:name>tempest-device-tagging-server-1444821796</nova:name>
Aug 16 16:41:25 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:41:21</nova:creationTime>
Aug 16 16:41:25 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:41:25 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:25 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:41:25 user nova-compute[73450]:       <nova:owner>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:user uuid="cb490f4920d5493a86210353f9c561fa">tempest-TaggedBootDevicesTest_v242-914937664-project-member</nova:user>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:project uuid="b27f7949860446f6939fbe2b5bb17e3c">tempest-TaggedBootDevicesTest_v242-914937664</nova:project>
Aug 16 16:41:25 user nova-compute[73450]:       </nova:owner>
Aug 16 16:41:25 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:25 user nova-compute[73450]:       <nova:ports>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="9d264822-7290-4f01-b32b-873399b35475">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="108ead71-9f6a-4812-8b78-dd8b5986057f">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.29" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="0faec9d5-bcd6-45a8-b203-e01e4e470d87">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="57bf521b-d547-4c96-891f-ba608307a692">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="454dd224-bbb2-4eec-a1e0-5a8ec6a2c108">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="30202e5f-2595-4bfb-b763-18a1e440f71b">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:         <nova:port uuid="be6d7573-6fa6-4a67-a8d3-2db1b0d2e921">
Aug 16 16:41:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 16:41:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:41:25 user nova-compute[73450]:       </nova:ports>
Aug 16 16:41:25 user nova-compute[73450]:     </nova:instance>
Aug 16 16:41:25 user nova-compute[73450]:   </metadata>
Aug 16 16:41:25 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:41:25 user nova-compute[73450]:     <system>
Aug 16 16:41:25 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:41:25 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:41:25 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:41:25 user nova-compute[73450]:       <entry name="serial">fe1c58b4-aece-4ab9-9979-4351104c23d4</entry>
Aug 16 16:41:25 user nova-compute[73450]:       <entry name="uuid">fe1c58b4-aece-4ab9-9979-4351104c23d4</entry>
Aug 16 16:41:25 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:41:25 user nova-compute[73450]:     </system>
Aug 16 16:41:25 user nova-compute[73450]:   </sysinfo>
Aug 16 16:41:25 user nova-compute[73450]:   <os>
Aug 16 16:41:25 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:41:25 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:41:25 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:41:25 user nova-compute[73450]:   </os>
Aug 16 16:41:25 user nova-compute[73450]:   <features>
Aug 16 16:41:25 user nova-compute[73450]:     <acpi/>
Aug 16 16:41:25 user nova-compute[73450]:     <apic/>
Aug 16 16:41:25 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:41:25 user nova-compute[73450]:   </features>
Aug 16 16:41:25 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:41:25 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:41:25 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:41:25 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:41:25 user nova-compute[73450]:   </clock>
Aug 16 16:41:25 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:41:25 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:41:25 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:41:25 user nova-compute[73450]:   </cpu>
Aug 16 16:41:25 user nova-compute[73450]:   <devices>
Aug 16 16:41:25 user nova-compute[73450]:     <disk type="file" device="cdrom">
Aug 16 16:41:25 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 16:41:25 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4/disk.config"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="hda" bus="ide"/>
Aug 16 16:41:25 user nova-compute[73450]:     </disk>
Aug 16 16:41:25 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:41:25 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:25 user nova-compute[73450]:       <source dev="/dev/sdd"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <serial>fb40c827-8f1a-445f-8b20-6fb2ed049953</serial>
Aug 16 16:41:25 user nova-compute[73450]:     </disk>
Aug 16 16:41:25 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:41:25 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:25 user nova-compute[73450]:       <source dev="/dev/sdg"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <serial>4a0a8458-6cc7-4561-8a21-615d26598e45</serial>
Aug 16 16:41:25 user nova-compute[73450]:     </disk>
Aug 16 16:41:25 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:41:25 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:25 user nova-compute[73450]:       <source dev="/dev/sdh"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="vdc" bus="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <serial>f29ac861-4609-440f-be50-a0e91d3dd122</serial>
Aug 16 16:41:25 user nova-compute[73450]:     </disk>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:10:40:88"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tap9d264822-72"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:34:18:a2"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tap108ead71-9f"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:3e:dc:32"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tap0faec9d5-bc"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:79:76:6a"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tap57bf521b-d5"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:10:84:ca"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tap454dd224-bb"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:1d:18:e9"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tap30202e5f-25"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:41:25 user nova-compute[73450]:       <mac address="fa:16:3e:4d:3d:b5"/>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:41:25 user nova-compute[73450]:       <target dev="tapbe6d7573-6f"/>
Aug 16 16:41:25 user nova-compute[73450]:     </interface>
Aug 16 16:41:25 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:41:25 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4/console.log" append="off"/>
Aug 16 16:41:25 user nova-compute[73450]:     </serial>
Aug 16 16:41:25 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:41:25 user nova-compute[73450]:     <video>
Aug 16 16:41:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:41:25 user nova-compute[73450]:     </video>
Aug 16 16:41:25 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:41:25 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:41:25 user nova-compute[73450]:     </rng>
Aug 16 16:41:25 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:41:25 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:41:25 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:41:25 user nova-compute[73450]:     </memballoon>
Aug 16 16:41:25 user nova-compute[73450]:   </devices>
Aug 16 16:41:25 user nova-compute[73450]: </domain>
Aug 16 16:41:25 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d264822-72, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d264822-72, col_values=(('external_ids', {'iface-id': '9d264822-7290-4f01-b32b-873399b35475', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:40:88', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap108ead71-9f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap108ead71-9f, col_values=(('external_ids', {'iface-id': '108ead71-9f6a-4812-8b78-dd8b5986057f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:18:a2', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0faec9d5-bc, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0faec9d5-bc, col_values=(('external_ids', {'iface-id': '0faec9d5-bcd6-45a8-b203-e01e4e470d87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:dc:32', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57bf521b-d5, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57bf521b-d5, col_values=(('external_ids', {'iface-id': '57bf521b-d547-4c96-891f-ba608307a692', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:76:6a', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap454dd224-bb, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap454dd224-bb, col_values=(('external_ids', {'iface-id': '454dd224-bbb2-4eec-a1e0-5a8ec6a2c108', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:84:ca', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30202e5f-25, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30202e5f-25, col_values=(('external_ids', {'iface-id': '30202e5f-2595-4bfb-b763-18a1e440f71b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:18:e9', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe6d7573-6f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe6d7573-6f, col_values=(('external_ids', {'iface-id': 'be6d7573-6fa6-4a67-a8d3-2db1b0d2e921', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:3d:b5', 'vm-uuid': 'fe1c58b4-aece-4ab9-9979-4351104c23d4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:25 user nova-compute[73450]: INFO os_vif [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f')
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] No BDM found with device name hda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] No VIF found with MAC fa:16:3e:10:40:88, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] No VIF found with MAC fa:16:3e:10:84:ca, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Using config drive
Aug 16 16:41:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Creating config drive at /opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4/disk.config
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz8yogm62 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz8yogm62" returned: 0 in 0.058s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjLAQEco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:26 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:26 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:26 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002c39a-cb3f-4120-954e-6f01ec5c083c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:26 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823ca8d-5624-4693-bdd2-7826e5117e3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced] added
Aug 16 16:41:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3245c2-c6ce-4547-8934-9c15f5c0405f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6960689b-60ec-45d4-b779-fb00370181c5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vjLAQEco {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vjLAQEco" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72e7380-5966-48c7-8f09-2a2fc332b539]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vjLAQEco'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4da1a0-6da3-47af-bbce-89ad2587f670]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a79d9-7a63-4c39-afc2-85413a025b5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'flavor' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38814f8-6ea2-4de1-b58b-17b46eea0c3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260]
Aug 16 16:41:26 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4063050b-d5bf-49af-aca4-233f79484a44]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aad980-e39d-4b69-a8ad-351e795979dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82843ce-e441-44b4-9b62-f7f7365b8ad5]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjLAQEco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:26 user nova-compute[73450]: INFO nova.compute.manager [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Attaching volume d6878906-d1cc-48b3-bbdb-6ce477e78eb2 to /dev/vdb
Aug 16 16:41:26 user nova-compute[73450]: DEBUG os_brick.utils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[764beab4-4ac2-4ace-842a-0f900b1531d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6aa162-be83-45de-beff-f67b22dca21e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce42cc-7091-4e94-a0a9-7d2f67a667ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1870b68-6897-4d46-a3fb-732797f3fdf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:27 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b33aa-66f7-43be-9f67-4fc245e361ac]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.utils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating existing volume attachment record: 5272893a-a2d1-455a-91b4-892800315058 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23033336537313535', 'path': '/dev/sdi'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033336537313535', 'path': '/dev/sdi'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-598053d6-eaad-4aa6-aa02-a02f0129388d req-d89ea292-d301-4414-8dc5-7e7bb750f490 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-598053d6-eaad-4aa6-aa02-a02f0129388d req-d89ea292-d301-4414-8dc5-7e7bb750f490 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-598053d6-eaad-4aa6-aa02-a02f0129388d req-d89ea292-d301-4414-8dc5-7e7bb750f490 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-598053d6-eaad-4aa6-aa02-a02f0129388d req-d89ea292-d301-4414-8dc5-7e7bb750f490 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-598053d6-eaad-4aa6-aa02-a02f0129388d req-d89ea292-d301-4414-8dc5-7e7bb750f490 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:27 user nova-compute[73450]: WARNING nova.compute.manager [req-598053d6-eaad-4aa6-aa02-a02f0129388d req-d89ea292-d301-4414-8dc5-7e7bb750f490 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 for instance with vm_state building and task_state spawning.
Aug 16 16:41:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG nova.objects.instance [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'flavor' on Instance uuid 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:41:27 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:27 user nova-compute[73450]:   <source dev="/dev/sdi"/>
Aug 16 16:41:27 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:27 user nova-compute[73450]:   <serial>18654112-79cd-401e-ad9a-2bbe63a03ced</serial>
Aug 16 16:41:27 user nova-compute[73450]: </disk>
Aug 16 16:41:27 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-9ffb6478-db5e-4951-a69d-3374ea51161e req-6bfaeb87-43bd-49d5-bdb7-eadd0c6cec77 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9ffb6478-db5e-4951-a69d-3374ea51161e req-6bfaeb87-43bd-49d5-bdb7-eadd0c6cec77 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9ffb6478-db5e-4951-a69d-3374ea51161e req-6bfaeb87-43bd-49d5-bdb7-eadd0c6cec77 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9ffb6478-db5e-4951-a69d-3374ea51161e req-6bfaeb87-43bd-49d5-bdb7-eadd0c6cec77 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-9ffb6478-db5e-4951-a69d-3374ea51161e req-6bfaeb87-43bd-49d5-bdb7-eadd0c6cec77 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:28 user nova-compute[73450]: WARNING nova.compute.manager [req-9ffb6478-db5e-4951-a69d-3374ea51161e req-6bfaeb87-43bd-49d5-bdb7-eadd0c6cec77 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f for instance with vm_state building and task_state spawning.
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-7787df6a-ef9c-4546-b90d-bc08cae1b9d3 req-f4e70952-5d3d-4d59-bdb6-4a8c83341011 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7787df6a-ef9c-4546-b90d-bc08cae1b9d3 req-f4e70952-5d3d-4d59-bdb6-4a8c83341011 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7787df6a-ef9c-4546-b90d-bc08cae1b9d3 req-f4e70952-5d3d-4d59-bdb6-4a8c83341011 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7787df6a-ef9c-4546-b90d-bc08cae1b9d3 req-f4e70952-5d3d-4d59-bdb6-4a8c83341011 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-7787df6a-ef9c-4546-b90d-bc08cae1b9d3 req-f4e70952-5d3d-4d59-bdb6-4a8c83341011 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:28 user nova-compute[73450]: WARNING nova.compute.manager [req-7787df6a-ef9c-4546-b90d-bc08cae1b9d3 req-f4e70952-5d3d-4d59-bdb6-4a8c83341011 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 for instance with vm_state building and task_state spawning.
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No VIF found with MAC fa:16:3e:4f:5b:3a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:29 user nova-compute[73450]: WARNING nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 for instance with vm_state building and task_state spawning.
Aug 16 16:41:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:29 user nova-compute[73450]: WARNING nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 for instance with vm_state building and task_state spawning.
Aug 16 16:41:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:29 user nova-compute[73450]: WARNING nova.compute.manager [req-458249a0-1389-48aa-81c1-e5cb8c1ffea1 req-2ba2aa8c-6dce-444c-adda-94480a3f80ff service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 for instance with vm_state building and task_state spawning.
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b8109f8-a619-4412-ba11-da5470e08fa5 req-bf896232-99fd-489e-ad7c-207dc973f352 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b8109f8-a619-4412-ba11-da5470e08fa5 req-bf896232-99fd-489e-ad7c-207dc973f352 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b8109f8-a619-4412-ba11-da5470e08fa5 req-bf896232-99fd-489e-ad7c-207dc973f352 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b8109f8-a619-4412-ba11-da5470e08fa5 req-bf896232-99fd-489e-ad7c-207dc973f352 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b8109f8-a619-4412-ba11-da5470e08fa5 req-bf896232-99fd-489e-ad7c-207dc973f352 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:30 user nova-compute[73450]: WARNING nova.compute.manager [req-3b8109f8-a619-4412-ba11-da5470e08fa5 req-bf896232-99fd-489e-ad7c-207dc973f352 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f for instance with vm_state building and task_state spawning.
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:30 user nova-compute[73450]: WARNING nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 for instance with vm_state building and task_state spawning.
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:30 user nova-compute[73450]: WARNING nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 for instance with vm_state building and task_state spawning.
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:30 user nova-compute[73450]: WARNING nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 for instance with vm_state building and task_state spawning.
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:30 user nova-compute[73450]: WARNING nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b for instance with vm_state building and task_state spawning.
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:30 user nova-compute[73450]: WARNING nova.compute.manager [req-c2856026-e992-4a86-9463-a32711fe7c31 req-daae1312-ae95-44f9-b39d-26efff8c5c9c service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b for instance with vm_state building and task_state spawning.
Aug 16 16:41:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEcfPMpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:31 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:31 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:31 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068d752-1540-409b-8f91-750abae8f588]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:31 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ca33ad-f924-490d-91d3-7dcef1046eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464] added
Aug 16 16:41:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[92587a16-e4b6-4dba-a5f7-ebb1ca63172b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eadbca-225c-49b3-a162-89a9f00a11b1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEcfPMpI {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEcfPMpI" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0fc95f-9423-4a0d-a60d-90345660bcdb]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEcfPMpI'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5819b6b-94de-482f-9c2d-750a83471e41]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772700f-8acf-4991-93b0-80fc6fb2bd6f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553e566e-f28d-4716-850a-acf48e5a284e tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.274s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4eeef7-d7c3-40c2-99ff-67c67bd5d233]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260]
Aug 16 16:41:31 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[192d7491-d3c1-4a1c-b177-cb3055938a89]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[18366606-c01c-4a64-9c9f-38e40202259e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f6292-a0e6-4b91-a818-048b781152d2]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEcfPMpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:31 user nova-compute[73450]: WARNING nova.compute.manager [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 for instance with vm_state building and task_state spawning.
Aug 16 16:41:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:31 user nova-compute[73450]: WARNING nova.compute.manager [req-4a3f1beb-ced0-4c52-8454-010874924dd1 req-917c0812-2f44-45ec-81f7-a9eb3de9187f service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 for instance with vm_state building and task_state spawning.
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204092.4404106, fe1c58b4-aece-4ab9-9979-4351104c23d4 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] VM Resumed (Lifecycle Event)
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance spawned successfully.
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204092.4450793, fe1c58b4-aece-4ab9-9979-4351104c23d4 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] VM Started (Lifecycle Event)
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Took 11.58 seconds to spawn the instance on the hypervisor.
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '26466653661336566', 'path': '/dev/sdk'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466653661336566', 'path': '/dev/sdk'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.objects.instance [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lazy-loading 'flavor' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 16:41:32 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:32 user nova-compute[73450]:   <source dev="/dev/sdk"/>
Aug 16 16:41:32 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:32 user nova-compute[73450]:   <serial>47d547c8-f48c-4a3f-9e14-11afafaf2464</serial>
Aug 16 16:41:32 user nova-compute[73450]: </disk>
Aug 16 16:41:32 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:41:32 user nova-compute[73450]: INFO nova.compute.manager [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Took 66.36 seconds to build instance.
Aug 16 16:41:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-32b9f97c-18f4-48a8-84ab-4f996f7bf715 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.493s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:33 user nova-compute[73450]: INFO nova.compute.manager [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Detaching volume 18654112-79cd-401e-ad9a-2bbe63a03ced
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] No VIF found with MAC fa:16:3e:0c:87:78, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:33 user nova-compute[73450]: INFO nova.virt.block_device [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Attempting to driver detach volume 18654112-79cd-401e-ad9a-2bbe63a03ced from mountpoint /dev/vdb
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Attempting to detach device vdb from instance 42484cde-66d6-4816-962b-912f6df59156 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:41:33 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:33 user nova-compute[73450]:   <source dev="/dev/sdi"/>
Aug 16 16:41:33 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:33 user nova-compute[73450]:   <serial>18654112-79cd-401e-ad9a-2bbe63a03ced</serial>
Aug 16 16:41:33 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:41:33 user nova-compute[73450]: </disk>
Aug 16 16:41:33 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Successfully detached device vdb from instance 42484cde-66d6-4816-962b-912f6df59156 from the persistent domain config.
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42484cde-66d6-4816-962b-912f6df59156 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:41:33 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:33 user nova-compute[73450]:   <source dev="/dev/sdi"/>
Aug 16 16:41:33 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:33 user nova-compute[73450]:   <serial>18654112-79cd-401e-ad9a-2bbe63a03ced</serial>
Aug 16 16:41:33 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:41:33 user nova-compute[73450]: </disk>
Aug 16 16:41:33 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3358d959-9de4-4325-bb69-bbb0b6dbb4c8 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.034s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] volume_snapshot_create: create_info: {'snapshot_id': 'c54e0f1d-a543-4fb9-b201-bbe19346ade5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73450) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] snap xml: <domainsnapshot>
Aug 16 16:41:33 user nova-compute[73450]:   <disks>
Aug 16 16:41:33 user nova-compute[73450]:     <disk name="/dev/sdk" snapshot="external" type="file">
Aug 16 16:41:33 user nova-compute[73450]:       <source file="/dev/new_file"/>
Aug 16 16:41:33 user nova-compute[73450]:     </disk>
Aug 16 16:41:33 user nova-compute[73450]:     <disk name="vda" snapshot="no"/>
Aug 16 16:41:33 user nova-compute[73450]:   </disks>
Aug 16 16:41:33 user nova-compute[73450]: </domainsnapshot>
Aug 16 16:41:33 user nova-compute[73450]:  {{(pid=73450) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lazy-loading 'system_metadata' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     rv = execute(f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     six.reraise(c, e, tb)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     raise value
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     rv = meth(*args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     self._volume_snapshot_create(context, instance, guest,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     rv = execute(f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     six.reraise(c, e, tb)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     raise value
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     rv = meth(*args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] 
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6597ca26-b456-4ea1-b28b-2f323c6b5de9 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] volume_snapshot_delete: delete_info: {'volume_id': '47d547c8-f48c-4a3f-9e14-11afafaf2464'} {{(pid=73450) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [None req-6597ca26-b456-4ea1-b28b-2f323c6b5de9 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221]     if delete_info['type'] != 'qcow2':
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] KeyError: 'type'
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] 
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204093.6965299, 42484cde-66d6-4816-962b-912f6df59156 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:41:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Successfully detached device vdb from instance 42484cde-66d6-4816-962b-912f6df59156 from the live domain config.
Aug 16 16:41:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjLAQEco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:33 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ee488-d10e-4ee7-8a09-6854276ec5d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c54e0f1d-a543-4fb9-b201-bbe19346ade5 could not be found.
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c54e0f1d-a543-4fb9-b201-bbe19346ade5 could not be found. (HTTP 404) (Request-ID: req-265c5441-ce92-485c-902f-93b84f357d20)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c54e0f1d-a543-4fb9-b201-bbe19346ade5 could not be found.
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server [None req-d4d8d00c-bbf3-4851-a526-5e3b124e639b tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver [None req-6597ca26-b456-4ea1-b28b-2f323c6b5de9 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-eff3e097-af89-4986-aa32-04b56863f815)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 16:41:33 user nova-compute[73450]: ERROR nova.virt.libvirt.driver 
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c80d8f-0fb2-4d62-91b7-154f2e9725ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2800269e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced'): ({'sdi'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Removing single pathed devices sdi {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server [None req-6597ca26-b456-4ea1-b28b-2f323c6b5de9 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 16:41:33 user nova-compute[73450]: ERROR oslo_messaging.rpc.server 
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819accf-2909-48ac-b74e-4d83f8f1c9eb]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad86066-626c-4bbf-8091-b721267cd3f5]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Flushing IO for device /dev/sdi {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe07f5-b5c6-499a-9510-0c5b5cde1440]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[336389ef-d246-48ce-bfcb-a98fdb51bfaa]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] SCSI volumes sdi have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a118774-48e3-48bb-b347-c90acfa2ec16]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4695140b-62e3-43cf-8d95-ea4f73a77bf9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260]
Aug 16 16:41:34 user nova-compute[73450]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18654112-79cd-401e-ad9a-2bbe63a03ced -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd222ac-fed3-4a83-85db-d82b255071b2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] <== disconnect_volume: return (408ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:34 user nova-compute[73450]: INFO nova.compute.manager [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Detaching volume 47d547c8-f48c-4a3f-9e14-11afafaf2464
Aug 16 16:41:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:41:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-changed-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Refreshing instance network info cache due to event network-changed-1895c3ed-6e8a-4cab-9eb9-d54458cb589f. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] Acquiring lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] Acquired lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Refreshing network info cache for port 1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updated VIF entry in instance network info cache for port 1895c3ed-6e8a-4cab-9eb9-d54458cb589f. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updating instance_info_cache with network_info: [{"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6ae28117-1108-431d-9b87-d0423170575a req-119581f6-4fdd-4076-bca1-b82571ca67c0 service nova] Releasing lock "refresh_cache-032e6ee8-4545-4867-a8ed-4076ed273174" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmYFbGrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:41 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18bd310-7510-4c45-ad23-5670ccc61d9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:41 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7738f80d-148f-4bfe-b341-e146c5989e4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2] added
Aug 16 16:41:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c30a0cf-3dcc-467f-9eae-97882549c7f3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2caf3fb-72f9-4c52-a8c2-6c685f3f5093]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WmYFbGrp {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WmYFbGrp" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49612cb-3325-4110-baac-e06fcca46361]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WmYFbGrp'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6683d225-a13b-4a76-9268-8e8acfb74255]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: INFO nova.virt.block_device [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Attempting to driver detach volume 47d547c8-f48c-4a3f-9e14-11afafaf2464 from mountpoint /dev/vdb
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.068s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8ad4fd-7c1e-4313-8721-3316b59db3a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Attempting to detach device vdb from instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 16:41:41 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:41 user nova-compute[73450]:   <source dev="/dev/sdk"/>
Aug 16 16:41:41 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:41 user nova-compute[73450]:   <serial>47d547c8-f48c-4a3f-9e14-11afafaf2464</serial>
Aug 16 16:41:41 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:41:41 user nova-compute[73450]: </disk>
Aug 16 16:41:41 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Successfully detached device vdb from instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 from the persistent domain config.
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 16:41:41 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:41 user nova-compute[73450]:   <source dev="/dev/sdk"/>
Aug 16 16:41:41 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:41 user nova-compute[73450]:   <serial>47d547c8-f48c-4a3f-9e14-11afafaf2464</serial>
Aug 16 16:41:41 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:41:41 user nova-compute[73450]: </disk>
Aug 16 16:41:41 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffcf8f8-c360-4e75-8770-375e22ce199f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260]
Aug 16 16:41:41 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56947b4-2c68-4b25-b5b8-4b7e91f30737]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[531c5bb2-504d-484b-9dd4-488bc9663ef6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.497s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee0e82b-392f-40ca-80dd-bf3c2145acc2]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmYFbGrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204102.117035, 816ac70d-0ed7-4bf0-ae30-f265f7889221 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:41:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Successfully detached device vdb from instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 from the live domain config.
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEcfPMpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:42 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: INFO nova.compute.manager [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Rebuilding instance
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'trusted_certs' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'pci_requests' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'pci_devices' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'resources' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'migration_context' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73450) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.601s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] <== connect_volume: return (1603ms) {'type': 'block', 'scsi_wwn': '23865383561373662', 'path': '/dev/sdi'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865383561373662', 'path': '/dev/sdi'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.637s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'flavor' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6461aba5-bce6-4d99-b3f9-4e8b3e50851a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:41:42 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:42 user nova-compute[73450]:   <source dev="/dev/sdi"/>
Aug 16 16:41:42 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:42 user nova-compute[73450]:   <serial>d6878906-d1cc-48b3-bbdb-6ce477e78eb2</serial>
Aug 16 16:41:42 user nova-compute[73450]: </disk>
Aug 16 16:41:42 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c2b989-70b7-4ead-8bb7-024a0bf3a288]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28015c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464'): ({'sdk'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Removing single pathed devices sdk {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af1652-2fe4-47a3-b029-558a7e72770e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c7637-290d-4405-864d-abbb79133941]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Flushing IO for device /dev/sdk {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d663e-b55c-4aff-be8a-ac742157e6ea]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:41:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.055s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b94c42-67bc-4e6a-82ec-51307615ee20]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] SCSI volumes sdk have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-bbff5123-51c3-4ab6-8e97-6e1e7152137c req-d99ec6aa-55b5-423d-a1d8-15e92df401d5 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-unplugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bbff5123-51c3-4ab6-8e97-6e1e7152137c req-d99ec6aa-55b5-423d-a1d8-15e92df401d5 service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bbff5123-51c3-4ab6-8e97-6e1e7152137c req-d99ec6aa-55b5-423d-a1d8-15e92df401d5 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bbff5123-51c3-4ab6-8e97-6e1e7152137c req-d99ec6aa-55b5-423d-a1d8-15e92df401d5 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-bbff5123-51c3-4ab6-8e97-6e1e7152137c req-d99ec6aa-55b5-423d-a1d8-15e92df401d5 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-unplugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:43 user nova-compute[73450]: WARNING nova.compute.manager [req-bbff5123-51c3-4ab6-8e97-6e1e7152137c req-d99ec6aa-55b5-423d-a1d8-15e92df401d5 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-unplugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state active and task_state rebuilding.
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c9441e-2b90-4569-9afe-07168cf877dc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.162s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad85d7-bfb9-4ec6-8133-bb9d692a070a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260]
Aug 16 16:41:43 user nova-compute[73450]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d547c8-f48c-4a3f-9e14-11afafaf2464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc1105d-59df-485a-ad8c-91146de78954]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.521s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] <== disconnect_volume: return (1159ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lazy-loading 'flavor' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:41:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=6993MB free_disk=24.392333984375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance destroyed successfully.
Aug 16 16:41:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance destroyed successfully.
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-854210172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1778060136',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGQW4pBqszV7GkT1DSqckRZr1tzOMllClEWD6zRoXgdh3JcdTpIdPRXKM3Rx82f0o7HhR4UciWWoPevsp5DyJaK5ckZnot8UqNXmT795b50ZFx8Z7y7dSRpvnbQLaQ5ow==',key_name='tempest-keypair-400554828',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41319fdc350640e18bd748deb70a3efc',ramdisk_id='',reservation_id='r-4z9dgjse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-592429353',owner_user_name='tempest-ServerActionsV293TestJSON-592429353-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1d1da8ff1204e8490b25aa909744e65',uuid=032e6ee8-4545-4867-a8ed-4076ed273174,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converting VIF {"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1895c3ed-6e, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No BDM found with device name hda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] No VIF found with MAC fa:16:3e:83:79:d8, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:44 user nova-compute[73450]: INFO os_vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e')
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:44 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f5d9b-6d6c-47ff-9350-157b60ba7259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de8301bd-eb46-4687-a58b-8f4e07069144 tempest-VolumesAssistedSnapshotsTest-258892671 tempest-VolumesAssistedSnapshotsTest-258892671-project-admin] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.302s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf66605-6f36-4a08-8c47-57a003b4019a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28015caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb8d7b-9885-4a9f-9f54-10bb184428b0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2130245c-71ff-4150-886c-ef67f72209b0]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a068f88-4dd4-4a03-9277-6724588f0fb6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 816ac70d-0ed7-4bf0-ae30-f265f7889221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 42484cde-66d6-4816-962b-912f6df59156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 408dc4d1-cbe3-4c99-b709-1956d987209a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032e6ee8-4545-4867-a8ed-4076ed273174 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 486b238c-d628-47c4-9c94-92639359a3ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance fe1c58b4-aece-4ab9-9979-4351104c23d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 86049569-07b7-43dc-98b9-796174986401 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63df9d3-f315-4e27-8f2e-abd1b468da46]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b94fd-4b98-48f0-96c2-6e48135e6703]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c40-9bb3-4a2b-bccf-e6d4bf5c701d tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.929s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e5cfcc-6f21-4363-85cf-50ec63b0ce6f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]
Aug 16 16:41:44 user nova-compute[73450]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5624f948-45c3-4738-a7e1-0ec7e22695fa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== disconnect_volume: return (391ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:41:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Deleting instance files /opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174_del
Aug 16 16:41:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Deletion of /opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174_del complete
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:41:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 032e6ee8-4545-4867-a8ed-4076ed273174 could not be found.
Aug 16 16:41:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:45 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[31481f71-42bc-49f8-a6fd-25bc7833122a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-45905a22-0c34-4548-9220-167d3a22784d req-da7c04f9-edc2-4643-99ea-a5f319b85adb service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-45905a22-0c34-4548-9220-167d3a22784d req-da7c04f9-edc2-4643-99ea-a5f319b85adb service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-45905a22-0c34-4548-9220-167d3a22784d req-da7c04f9-edc2-4643-99ea-a5f319b85adb service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-45905a22-0c34-4548-9220-167d3a22784d req-da7c04f9-edc2-4643-99ea-a5f319b85adb service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-45905a22-0c34-4548-9220-167d3a22784d req-da7c04f9-edc2-4643-99ea-a5f319b85adb service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:45 user nova-compute[73450]: WARNING nova.compute.manager [req-45905a22-0c34-4548-9220-167d3a22784d req-da7c04f9-edc2-4643-99ea-a5f319b85adb service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state active and task_state rebuilding.
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d36cd4-5206-4275-b5a0-b944d8f23ced]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:45 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28b067b50>, {}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Disconnecting from: [] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== disconnect_volume: return (76ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updating instance_info_cache with network_info: [{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'flavor' on Instance uuid 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a8c89c15-69fc-4ee3-9cad-990402203638 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 15.456s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEJfDSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:48 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:48 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:48 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d6b867-f126-4bc7-9391-050d92fe8594]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:41:48 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb18ad9-60fc-4e16-8b78-efab9952e8da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73] added
Aug 16 16:41:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f6ab66-ec43-4dea-9647-1abd05882338]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c020fe7-2a81-4e50-b610-1ecada8e549a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKEJfDSA {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKEJfDSA" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8093a3-1e73-4548-8b41-3e6eec7b5efc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKEJfDSA'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Preparing to wait for external event volume-reimaged-271210ae-b56b-4e19-a04a-c53c352dd3a9 {{(pid=73450) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e59b51-900e-4553-bdb7-cb21c2cff159]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7c4a74-6ee8-45e2-aae4-92a32f085147]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c1bca-e0f8-45e4-8d88-865b93f2a2a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260]
Aug 16 16:41:49 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf7625-7712-41e1-a2e2-4a0af971b78e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8ea0f1-7315-48e9-84df-7541c284b0bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53adb02-d256-47f9-9f1c-9e8b0fca7daa]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEJfDSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:49 user nova-compute[73450]: INFO nova.compute.manager [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Detaching volume d6878906-d1cc-48b3-bbdb-6ce477e78eb2
Aug 16 16:41:49 user nova-compute[73450]: INFO nova.virt.block_device [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Attempting to driver detach volume d6878906-d1cc-48b3-bbdb-6ce477e78eb2 from mountpoint /dev/vdb
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Attempting to detach device vdb from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:41:49 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:49 user nova-compute[73450]:   <source dev="/dev/sdi"/>
Aug 16 16:41:49 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:49 user nova-compute[73450]:   <serial>d6878906-d1cc-48b3-bbdb-6ce477e78eb2</serial>
Aug 16 16:41:49 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 16:41:49 user nova-compute[73450]: </disk>
Aug 16 16:41:49 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully detached device vdb from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the persistent domain config.
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:41:49 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:49 user nova-compute[73450]:   <source dev="/dev/sdi"/>
Aug 16 16:41:49 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:49 user nova-compute[73450]:   <serial>d6878906-d1cc-48b3-bbdb-6ce477e78eb2</serial>
Aug 16 16:41:49 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 16:41:49 user nova-compute[73450]: </disk>
Aug 16 16:41:49 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204109.981614, 408dc4d1-cbe3-4c99-b709-1956d987209a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:41:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully detached device vdb from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the live domain config.
Aug 16 16:41:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmYFbGrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:49 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:41:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23439363738623233', 'path': '/dev/sdk'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439363738623233', 'path': '/dev/sdk'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.244s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.objects.instance [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lazy-loading 'flavor' on Instance uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f4e78-44e7-409a-821d-0f61e8f50953]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:41:50 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:41:50 user nova-compute[73450]:   <source dev="/dev/sdk"/>
Aug 16 16:41:50 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:41:50 user nova-compute[73450]:   <serial>44f5ea9e-edc6-47a3-be04-30326a9f5b73</serial>
Aug 16 16:41:50 user nova-compute[73450]: </disk>
Aug 16 16:41:50 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde94110-d0f2-4c66-aec6-8546679f0fa1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6de7ca7-433a-40d4-8821-1fb57a4228a6 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df281ce5-b092-4d1d-9a82-f070410c39fd (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:41:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe280024c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2'): ({'sdi'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Removing single pathed devices sdi {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b61472e-0198-429b-aa30-b5ee8a7b6382]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2136fd-fdbe-4ec5-8dfc-42b45af5f28f]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Flushing IO for device /dev/sdi {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a023069-a046-4a38-88fe-a38b29e566f9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d6647e-7b04-4e30-954a-3c37b341f400]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] SCSI volumes sdi have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f256cd89-d969-4b29-8706-4013e91aadaa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fdc101-5187-484e-8a6b-82624301625a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260]
Aug 16 16:41:50 user nova-compute[73450]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2, portal: 172.16.0.220,3260] successful.
Aug 16 16:41:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6878906-d1cc-48b3-bbdb-6ce477e78eb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c67f9a-e873-4993-a732-828cb7c4d139]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] <== disconnect_volume: return (618ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] No VIF found with MAC fa:16:3e:ac:8e:aa, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:41:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce9de104-798d-42e4-b214-7b05523c8b5e tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.781s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:51 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'flavor' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6b3b4fd7-4d6d-4ea1-8879-7fe61b39ee54 tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.413s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b4066c-979e-45be-b393-71257d544878]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60675c-00f9-49aa-aa9b-c9da62f3897c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8262a255-db37-4c2f-a558-a6191d3c1eba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ef3d3-94db-485f-9f11-bb4412f4b55b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:41:52 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c79ea-796f-485a-b64b-b71a50a03f93]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:41:52 user nova-compute[73450]: INFO nova.compute.manager [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Swapping volume 44f5ea9e-edc6-47a3-be04-30326a9f5b73 for 31b703f3-fb0b-411d-a729-10ea8a57eef5
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "interface-408dc4d1-cbe3-4c99-b709-1956d987209a-29b80381-cce8-4301-8960-d836347f6f35" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "interface-408dc4d1-cbe3-4c99-b709-1956d987209a-29b80381-cce8-4301-8960-d836347f6f35" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'flavor' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface> {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface> {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Attempting to detach device tap29b80381-cc from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] detach device xml: <interface type="ethernet">
Aug 16 16:41:52 user nova-compute[73450]:   <mac address="fa:16:3e:f1:7f:07"/>
Aug 16 16:41:52 user nova-compute[73450]:   <model type="virtio"/>
Aug 16 16:41:52 user nova-compute[73450]:   <mtu size="1442"/>
Aug 16 16:41:52 user nova-compute[73450]:   <target dev="tap29b80381-cc"/>
Aug 16 16:41:52 user nova-compute[73450]: </interface>
Aug 16 16:41:52 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface> {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 16:41:52 user nova-compute[73450]:   <name>instance-00000007</name>
Aug 16 16:41:52 user nova-compute[73450]:   <uuid>408dc4d1-cbe3-4c99-b709-1956d987209a</uuid>
Aug 16 16:41:52 user nova-compute[73450]:   <metadata>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:52 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:52 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:52 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:21</nova:creationTime>
Aug 16 16:41:52 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:52 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:52 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:52 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:52 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:52 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:52 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:52 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:52 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:52 user nova-compute[73450]:     <nova:port uuid="29b80381-cce8-4301-8960-d836347f6f35">
Aug 16 16:41:52 user nova-compute[73450]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 16 16:41:52 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:52 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:52 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:52 user nova-compute[73450]:   </metadata>
Aug 16 16:41:52 user nova-compute[73450]:   <memory unit='KiB'>524288</memory>
Aug 16 16:41:52 user nova-compute[73450]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 16:41:52 user nova-compute[73450]:   <vcpu placement='static'>1</vcpu>
Aug 16 16:41:52 user nova-compute[73450]:   <resource>
Aug 16 16:41:52 user nova-compute[73450]:     <partition>/machine</partition>
Aug 16 16:41:52 user nova-compute[73450]:   </resource>
Aug 16 16:41:52 user nova-compute[73450]:   <sysinfo type='smbios'>
Aug 16 16:41:52 user nova-compute[73450]:     <system>
Aug 16 16:41:52 user nova-compute[73450]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 16:41:52 user nova-compute[73450]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 16:41:52 user nova-compute[73450]:       <entry name='version'>0.0.0</entry>
Aug 16 16:41:52 user nova-compute[73450]:       <entry name='serial'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:52 user nova-compute[73450]:       <entry name='uuid'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:52 user nova-compute[73450]:       <entry name='family'>Virtual Machine</entry>
Aug 16 16:41:52 user nova-compute[73450]:     </system>
Aug 16 16:41:52 user nova-compute[73450]:   </sysinfo>
Aug 16 16:41:52 user nova-compute[73450]:   <os>
Aug 16 16:41:52 user nova-compute[73450]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 16:41:52 user nova-compute[73450]:     <boot dev='hd'/>
Aug 16 16:41:52 user nova-compute[73450]:     <smbios mode='sysinfo'/>
Aug 16 16:41:52 user nova-compute[73450]:   </os>
Aug 16 16:41:52 user nova-compute[73450]:   <features>
Aug 16 16:41:52 user nova-compute[73450]:     <acpi/>
Aug 16 16:41:52 user nova-compute[73450]:     <apic/>
Aug 16 16:41:52 user nova-compute[73450]:     <vmcoreinfo state='on'/>
Aug 16 16:41:52 user nova-compute[73450]:   </features>
Aug 16 16:41:52 user nova-compute[73450]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 16:41:52 user nova-compute[73450]:     <model fallback='forbid'>Nehalem</model>
Aug 16 16:41:52 user nova-compute[73450]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 16:41:52 user nova-compute[73450]:     <feature policy='require' name='vme'/>
Aug 16 16:41:52 user nova-compute[73450]:     <feature policy='require' name='x2apic'/>
Aug 16 16:41:52 user nova-compute[73450]:     <feature policy='require' name='hypervisor'/>
Aug 16 16:41:52 user nova-compute[73450]:   </cpu>
Aug 16 16:41:52 user nova-compute[73450]:   <clock offset='utc'>
Aug 16 16:41:52 user nova-compute[73450]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 16:41:52 user nova-compute[73450]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 16:41:52 user nova-compute[73450]:     <timer name='hpet' present='no'/>
Aug 16 16:41:52 user nova-compute[73450]:   </clock>
Aug 16 16:41:52 user nova-compute[73450]:   <on_poweroff>destroy</on_poweroff>
Aug 16 16:41:52 user nova-compute[73450]:   <on_reboot>restart</on_reboot>
Aug 16 16:41:52 user nova-compute[73450]:   <on_crash>destroy</on_crash>
Aug 16 16:41:52 user nova-compute[73450]:   <devices>
Aug 16 16:41:52 user nova-compute[73450]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 16:41:52 user nova-compute[73450]:     <disk type='file' device='disk'>
Aug 16 16:41:52 user nova-compute[73450]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 16:41:52 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk' index='2'/>
Aug 16 16:41:52 user nova-compute[73450]:       <backingStore type='file' index='3'>
Aug 16 16:41:52 user nova-compute[73450]:         <format type='raw'/>
Aug 16 16:41:52 user nova-compute[73450]:         <source file='/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e'/>
Aug 16 16:41:52 user nova-compute[73450]:         <backingStore/>
Aug 16 16:41:52 user nova-compute[73450]:       </backingStore>
Aug 16 16:41:52 user nova-compute[73450]:       <target dev='vda' bus='virtio'/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='virtio-disk0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </disk>
Aug 16 16:41:52 user nova-compute[73450]:     <disk type='file' device='cdrom'>
Aug 16 16:41:52 user nova-compute[73450]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 16:41:52 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config' index='1'/>
Aug 16 16:41:52 user nova-compute[73450]:       <backingStore/>
Aug 16 16:41:52 user nova-compute[73450]:       <target dev='hda' bus='ide'/>
Aug 16 16:41:52 user nova-compute[73450]:       <readonly/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='ide0-0-0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </disk>
Aug 16 16:41:52 user nova-compute[73450]:     <controller type='usb' index='0' model='none'>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='usb'/>
Aug 16 16:41:52 user nova-compute[73450]:     </controller>
Aug 16 16:41:52 user nova-compute[73450]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='pci.0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </controller>
Aug 16 16:41:52 user nova-compute[73450]:     <controller type='ide' index='0'>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='ide'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 16:41:52 user nova-compute[73450]:     </controller>
Aug 16 16:41:52 user nova-compute[73450]:     <interface type='ethernet'>
Aug 16 16:41:52 user nova-compute[73450]:       <mac address='fa:16:3e:83:79:d8'/>
Aug 16 16:41:52 user nova-compute[73450]:       <target dev='tap28373f47-5f'/>
Aug 16 16:41:52 user nova-compute[73450]:       <model type='virtio'/>
Aug 16 16:41:52 user nova-compute[73450]:       <mtu size='1442'/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='net0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </interface>
Aug 16 16:41:52 user nova-compute[73450]:     <interface type='ethernet'>
Aug 16 16:41:52 user nova-compute[73450]:       <mac address='fa:16:3e:f1:7f:07'/>
Aug 16 16:41:52 user nova-compute[73450]:       <target dev='tap29b80381-cc'/>
Aug 16 16:41:52 user nova-compute[73450]:       <model type='virtio'/>
Aug 16 16:41:52 user nova-compute[73450]:       <mtu size='1442'/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='net1'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </interface>
Aug 16 16:41:52 user nova-compute[73450]:     <serial type='pty'>
Aug 16 16:41:52 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:52 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:52 user nova-compute[73450]:       <target type='isa-serial' port='0'>
Aug 16 16:41:52 user nova-compute[73450]:         <model name='isa-serial'/>
Aug 16 16:41:52 user nova-compute[73450]:       </target>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </serial>
Aug 16 16:41:52 user nova-compute[73450]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 16:41:52 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:52 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:52 user nova-compute[73450]:       <target type='serial' port='0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </console>
Aug 16 16:41:52 user nova-compute[73450]:     <input type='mouse' bus='ps2'>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='input0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </input>
Aug 16 16:41:52 user nova-compute[73450]:     <input type='keyboard' bus='ps2'>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='input1'/>
Aug 16 16:41:52 user nova-compute[73450]:     </input>
Aug 16 16:41:52 user nova-compute[73450]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 16:41:52 user nova-compute[73450]:       <listen type='address' address='0.0.0.0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </graphics>
Aug 16 16:41:52 user nova-compute[73450]:     <audio id='1' type='none'/>
Aug 16 16:41:52 user nova-compute[73450]:     <video>
Aug 16 16:41:52 user nova-compute[73450]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='video0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </video>
Aug 16 16:41:52 user nova-compute[73450]:     <memballoon model='virtio'>
Aug 16 16:41:52 user nova-compute[73450]:       <stats period='10'/>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='balloon0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </memballoon>
Aug 16 16:41:52 user nova-compute[73450]:     <rng model='virtio'>
Aug 16 16:41:52 user nova-compute[73450]:       <backend model='random'>/dev/urandom</backend>
Aug 16 16:41:52 user nova-compute[73450]:       <alias name='rng0'/>
Aug 16 16:41:52 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 16:41:52 user nova-compute[73450]:     </rng>
Aug 16 16:41:52 user nova-compute[73450]:   </devices>
Aug 16 16:41:52 user nova-compute[73450]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 16:41:52 user nova-compute[73450]:     <label>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</label>
Aug 16 16:41:52 user nova-compute[73450]:     <imagelabel>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</imagelabel>
Aug 16 16:41:52 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:52 user nova-compute[73450]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 16:41:52 user nova-compute[73450]:     <label>+64055:+108</label>
Aug 16 16:41:52 user nova-compute[73450]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 16:41:52 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:52 user nova-compute[73450]: </domain>
Aug 16 16:41:52 user nova-compute[73450]:  {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 16:41:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully detached device tap29b80381-cc from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the persistent domain config.
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] (1/8): Attempting to detach device tap29b80381-cc with device alias net1 from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:41:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] detach device xml: <interface type="ethernet">
Aug 16 16:41:52 user nova-compute[73450]:   <mac address="fa:16:3e:f1:7f:07"/>
Aug 16 16:41:52 user nova-compute[73450]:   <model type="virtio"/>
Aug 16 16:41:52 user nova-compute[73450]:   <mtu size="1442"/>
Aug 16 16:41:52 user nova-compute[73450]:   <target dev="tap29b80381-cc"/>
Aug 16 16:41:52 user nova-compute[73450]: </interface>
Aug 16 16:41:52 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204113.1828003, 408dc4d1-cbe3-4c99-b709-1956d987209a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Start waiting for the detach event from libvirt for device tap29b80381-cc with device alias net1 for instance 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface> {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 16:41:53 user nova-compute[73450]:   <name>instance-00000007</name>
Aug 16 16:41:53 user nova-compute[73450]:   <uuid>408dc4d1-cbe3-4c99-b709-1956d987209a</uuid>
Aug 16 16:41:53 user nova-compute[73450]:   <metadata>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:53 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:21</nova:creationTime>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:53 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:53 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:53 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:53 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:53 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:port uuid="29b80381-cce8-4301-8960-d836347f6f35">
Aug 16 16:41:53 user nova-compute[73450]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 16 16:41:53 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:53 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:53 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:53 user nova-compute[73450]:   </metadata>
Aug 16 16:41:53 user nova-compute[73450]:   <memory unit='KiB'>524288</memory>
Aug 16 16:41:53 user nova-compute[73450]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 16:41:53 user nova-compute[73450]:   <vcpu placement='static'>1</vcpu>
Aug 16 16:41:53 user nova-compute[73450]:   <resource>
Aug 16 16:41:53 user nova-compute[73450]:     <partition>/machine</partition>
Aug 16 16:41:53 user nova-compute[73450]:   </resource>
Aug 16 16:41:53 user nova-compute[73450]:   <sysinfo type='smbios'>
Aug 16 16:41:53 user nova-compute[73450]:     <system>
Aug 16 16:41:53 user nova-compute[73450]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 16:41:53 user nova-compute[73450]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 16:41:53 user nova-compute[73450]:       <entry name='version'>0.0.0</entry>
Aug 16 16:41:53 user nova-compute[73450]:       <entry name='serial'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:53 user nova-compute[73450]:       <entry name='uuid'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:53 user nova-compute[73450]:       <entry name='family'>Virtual Machine</entry>
Aug 16 16:41:53 user nova-compute[73450]:     </system>
Aug 16 16:41:53 user nova-compute[73450]:   </sysinfo>
Aug 16 16:41:53 user nova-compute[73450]:   <os>
Aug 16 16:41:53 user nova-compute[73450]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 16:41:53 user nova-compute[73450]:     <boot dev='hd'/>
Aug 16 16:41:53 user nova-compute[73450]:     <smbios mode='sysinfo'/>
Aug 16 16:41:53 user nova-compute[73450]:   </os>
Aug 16 16:41:53 user nova-compute[73450]:   <features>
Aug 16 16:41:53 user nova-compute[73450]:     <acpi/>
Aug 16 16:41:53 user nova-compute[73450]:     <apic/>
Aug 16 16:41:53 user nova-compute[73450]:     <vmcoreinfo state='on'/>
Aug 16 16:41:53 user nova-compute[73450]:   </features>
Aug 16 16:41:53 user nova-compute[73450]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 16:41:53 user nova-compute[73450]:     <model fallback='forbid'>Nehalem</model>
Aug 16 16:41:53 user nova-compute[73450]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 16:41:53 user nova-compute[73450]:     <feature policy='require' name='vme'/>
Aug 16 16:41:53 user nova-compute[73450]:     <feature policy='require' name='x2apic'/>
Aug 16 16:41:53 user nova-compute[73450]:     <feature policy='require' name='hypervisor'/>
Aug 16 16:41:53 user nova-compute[73450]:   </cpu>
Aug 16 16:41:53 user nova-compute[73450]:   <clock offset='utc'>
Aug 16 16:41:53 user nova-compute[73450]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 16:41:53 user nova-compute[73450]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 16:41:53 user nova-compute[73450]:     <timer name='hpet' present='no'/>
Aug 16 16:41:53 user nova-compute[73450]:   </clock>
Aug 16 16:41:53 user nova-compute[73450]:   <on_poweroff>destroy</on_poweroff>
Aug 16 16:41:53 user nova-compute[73450]:   <on_reboot>restart</on_reboot>
Aug 16 16:41:53 user nova-compute[73450]:   <on_crash>destroy</on_crash>
Aug 16 16:41:53 user nova-compute[73450]:   <devices>
Aug 16 16:41:53 user nova-compute[73450]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 16:41:53 user nova-compute[73450]:     <disk type='file' device='disk'>
Aug 16 16:41:53 user nova-compute[73450]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 16:41:53 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk' index='2'/>
Aug 16 16:41:53 user nova-compute[73450]:       <backingStore type='file' index='3'>
Aug 16 16:41:53 user nova-compute[73450]:         <format type='raw'/>
Aug 16 16:41:53 user nova-compute[73450]:         <source file='/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e'/>
Aug 16 16:41:53 user nova-compute[73450]:         <backingStore/>
Aug 16 16:41:53 user nova-compute[73450]:       </backingStore>
Aug 16 16:41:53 user nova-compute[73450]:       <target dev='vda' bus='virtio'/>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='virtio-disk0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </disk>
Aug 16 16:41:53 user nova-compute[73450]:     <disk type='file' device='cdrom'>
Aug 16 16:41:53 user nova-compute[73450]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 16:41:53 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config' index='1'/>
Aug 16 16:41:53 user nova-compute[73450]:       <backingStore/>
Aug 16 16:41:53 user nova-compute[73450]:       <target dev='hda' bus='ide'/>
Aug 16 16:41:53 user nova-compute[73450]:       <readonly/>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='ide0-0-0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </disk>
Aug 16 16:41:53 user nova-compute[73450]:     <controller type='usb' index='0' model='none'>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='usb'/>
Aug 16 16:41:53 user nova-compute[73450]:     </controller>
Aug 16 16:41:53 user nova-compute[73450]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='pci.0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </controller>
Aug 16 16:41:53 user nova-compute[73450]:     <controller type='ide' index='0'>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='ide'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 16:41:53 user nova-compute[73450]:     </controller>
Aug 16 16:41:53 user nova-compute[73450]:     <interface type='ethernet'>
Aug 16 16:41:53 user nova-compute[73450]:       <mac address='fa:16:3e:83:79:d8'/>
Aug 16 16:41:53 user nova-compute[73450]:       <target dev='tap28373f47-5f'/>
Aug 16 16:41:53 user nova-compute[73450]:       <model type='virtio'/>
Aug 16 16:41:53 user nova-compute[73450]:       <mtu size='1442'/>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='net0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </interface>
Aug 16 16:41:53 user nova-compute[73450]:     <serial type='pty'>
Aug 16 16:41:53 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:53 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:53 user nova-compute[73450]:       <target type='isa-serial' port='0'>
Aug 16 16:41:53 user nova-compute[73450]:         <model name='isa-serial'/>
Aug 16 16:41:53 user nova-compute[73450]:       </target>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </serial>
Aug 16 16:41:53 user nova-compute[73450]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 16:41:53 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:53 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:53 user nova-compute[73450]:       <target type='serial' port='0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </console>
Aug 16 16:41:53 user nova-compute[73450]:     <input type='mouse' bus='ps2'>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='input0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </input>
Aug 16 16:41:53 user nova-compute[73450]:     <input type='keyboard' bus='ps2'>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='input1'/>
Aug 16 16:41:53 user nova-compute[73450]:     </input>
Aug 16 16:41:53 user nova-compute[73450]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 16:41:53 user nova-compute[73450]:       <listen type='address' address='0.0.0.0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </graphics>
Aug 16 16:41:53 user nova-compute[73450]:     <audio id='1' type='none'/>
Aug 16 16:41:53 user nova-compute[73450]:     <video>
Aug 16 16:41:53 user nova-compute[73450]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='video0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </video>
Aug 16 16:41:53 user nova-compute[73450]:     <memballoon model='virtio'>
Aug 16 16:41:53 user nova-compute[73450]:       <stats period='10'/>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='balloon0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </memballoon>
Aug 16 16:41:53 user nova-compute[73450]:     <rng model='virtio'>
Aug 16 16:41:53 user nova-compute[73450]:       <backend model='random'>/dev/urandom</backend>
Aug 16 16:41:53 user nova-compute[73450]:       <alias name='rng0'/>
Aug 16 16:41:53 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 16:41:53 user nova-compute[73450]:     </rng>
Aug 16 16:41:53 user nova-compute[73450]:   </devices>
Aug 16 16:41:53 user nova-compute[73450]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 16:41:53 user nova-compute[73450]:     <label>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</label>
Aug 16 16:41:53 user nova-compute[73450]:     <imagelabel>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</imagelabel>
Aug 16 16:41:53 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:53 user nova-compute[73450]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 16:41:53 user nova-compute[73450]:     <label>+64055:+108</label>
Aug 16 16:41:53 user nova-compute[73450]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 16:41:53 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:53 user nova-compute[73450]: </domain>
Aug 16 16:41:53 user nova-compute[73450]:  {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 16:41:53 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully detached device tap29b80381-cc from instance 408dc4d1-cbe3-4c99-b709-1956d987209a from the live domain config.
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG os_vif [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29b80381-cc, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: INFO os_vif [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc')
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:53 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:53</nova:creationTime>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:53 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:53 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:53 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:53 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:53 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:53 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:53 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:53 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:53 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:53 user nova-compute[73450]:  {{(pid=73450) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-b5ca4978-6866-4991-a399-21936f72aa06 req-a9e62755-8617-43df-8757-de51f2d45670 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-unplugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b5ca4978-6866-4991-a399-21936f72aa06 req-a9e62755-8617-43df-8757-de51f2d45670 service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b5ca4978-6866-4991-a399-21936f72aa06 req-a9e62755-8617-43df-8757-de51f2d45670 service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b5ca4978-6866-4991-a399-21936f72aa06 req-a9e62755-8617-43df-8757-de51f2d45670 service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-b5ca4978-6866-4991-a399-21936f72aa06 req-a9e62755-8617-43df-8757-de51f2d45670 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-unplugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:53 user nova-compute[73450]: WARNING nova.compute.manager [req-b5ca4978-6866-4991-a399-21936f72aa06 req-a9e62755-8617-43df-8757-de51f2d45670 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-unplugged-29b80381-cce8-4301-8960-d836347f6f35 for instance with vm_state active and task_state None.
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-deleted-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:54 user nova-compute[73450]: INFO nova.compute.manager [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Neutron deleted interface 29b80381-cce8-4301-8960-d836347f6f35; detaching it from the instance and deleting it from the info cache
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.neutron [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquired lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.objects.instance [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Lazy-loading 'system_metadata' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.objects.instance [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Lazy-loading 'flavor' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.os_vif_util [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Converting VIF {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.os_vif_util [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface> {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 16:41:54 user nova-compute[73450]:   <name>instance-00000007</name>
Aug 16 16:41:54 user nova-compute[73450]:   <uuid>408dc4d1-cbe3-4c99-b709-1956d987209a</uuid>
Aug 16 16:41:54 user nova-compute[73450]:   <metadata>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:54 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:53</nova:creationTime>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:54 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:54 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:54 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:54 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:54 user nova-compute[73450]:   </metadata>
Aug 16 16:41:54 user nova-compute[73450]:   <memory unit='KiB'>524288</memory>
Aug 16 16:41:54 user nova-compute[73450]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 16:41:54 user nova-compute[73450]:   <vcpu placement='static'>1</vcpu>
Aug 16 16:41:54 user nova-compute[73450]:   <resource>
Aug 16 16:41:54 user nova-compute[73450]:     <partition>/machine</partition>
Aug 16 16:41:54 user nova-compute[73450]:   </resource>
Aug 16 16:41:54 user nova-compute[73450]:   <sysinfo type='smbios'>
Aug 16 16:41:54 user nova-compute[73450]:     <system>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='version'>0.0.0</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='serial'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='uuid'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='family'>Virtual Machine</entry>
Aug 16 16:41:54 user nova-compute[73450]:     </system>
Aug 16 16:41:54 user nova-compute[73450]:   </sysinfo>
Aug 16 16:41:54 user nova-compute[73450]:   <os>
Aug 16 16:41:54 user nova-compute[73450]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 16:41:54 user nova-compute[73450]:     <boot dev='hd'/>
Aug 16 16:41:54 user nova-compute[73450]:     <smbios mode='sysinfo'/>
Aug 16 16:41:54 user nova-compute[73450]:   </os>
Aug 16 16:41:54 user nova-compute[73450]:   <features>
Aug 16 16:41:54 user nova-compute[73450]:     <acpi/>
Aug 16 16:41:54 user nova-compute[73450]:     <apic/>
Aug 16 16:41:54 user nova-compute[73450]:     <vmcoreinfo state='on'/>
Aug 16 16:41:54 user nova-compute[73450]:   </features>
Aug 16 16:41:54 user nova-compute[73450]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 16:41:54 user nova-compute[73450]:     <model fallback='forbid'>Nehalem</model>
Aug 16 16:41:54 user nova-compute[73450]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 16:41:54 user nova-compute[73450]:     <feature policy='require' name='vme'/>
Aug 16 16:41:54 user nova-compute[73450]:     <feature policy='require' name='x2apic'/>
Aug 16 16:41:54 user nova-compute[73450]:     <feature policy='require' name='hypervisor'/>
Aug 16 16:41:54 user nova-compute[73450]:   </cpu>
Aug 16 16:41:54 user nova-compute[73450]:   <clock offset='utc'>
Aug 16 16:41:54 user nova-compute[73450]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 16:41:54 user nova-compute[73450]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 16:41:54 user nova-compute[73450]:     <timer name='hpet' present='no'/>
Aug 16 16:41:54 user nova-compute[73450]:   </clock>
Aug 16 16:41:54 user nova-compute[73450]:   <on_poweroff>destroy</on_poweroff>
Aug 16 16:41:54 user nova-compute[73450]:   <on_reboot>restart</on_reboot>
Aug 16 16:41:54 user nova-compute[73450]:   <on_crash>destroy</on_crash>
Aug 16 16:41:54 user nova-compute[73450]:   <devices>
Aug 16 16:41:54 user nova-compute[73450]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 16:41:54 user nova-compute[73450]:     <disk type='file' device='disk'>
Aug 16 16:41:54 user nova-compute[73450]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 16:41:54 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk' index='2'/>
Aug 16 16:41:54 user nova-compute[73450]:       <backingStore type='file' index='3'>
Aug 16 16:41:54 user nova-compute[73450]:         <format type='raw'/>
Aug 16 16:41:54 user nova-compute[73450]:         <source file='/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e'/>
Aug 16 16:41:54 user nova-compute[73450]:         <backingStore/>
Aug 16 16:41:54 user nova-compute[73450]:       </backingStore>
Aug 16 16:41:54 user nova-compute[73450]:       <target dev='vda' bus='virtio'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='virtio-disk0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </disk>
Aug 16 16:41:54 user nova-compute[73450]:     <disk type='file' device='cdrom'>
Aug 16 16:41:54 user nova-compute[73450]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 16:41:54 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config' index='1'/>
Aug 16 16:41:54 user nova-compute[73450]:       <backingStore/>
Aug 16 16:41:54 user nova-compute[73450]:       <target dev='hda' bus='ide'/>
Aug 16 16:41:54 user nova-compute[73450]:       <readonly/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='ide0-0-0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </disk>
Aug 16 16:41:54 user nova-compute[73450]:     <controller type='usb' index='0' model='none'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='usb'/>
Aug 16 16:41:54 user nova-compute[73450]:     </controller>
Aug 16 16:41:54 user nova-compute[73450]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='pci.0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </controller>
Aug 16 16:41:54 user nova-compute[73450]:     <controller type='ide' index='0'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='ide'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 16:41:54 user nova-compute[73450]:     </controller>
Aug 16 16:41:54 user nova-compute[73450]:     <interface type='ethernet'>
Aug 16 16:41:54 user nova-compute[73450]:       <mac address='fa:16:3e:83:79:d8'/>
Aug 16 16:41:54 user nova-compute[73450]:       <target dev='tap28373f47-5f'/>
Aug 16 16:41:54 user nova-compute[73450]:       <model type='virtio'/>
Aug 16 16:41:54 user nova-compute[73450]:       <mtu size='1442'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='net0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </interface>
Aug 16 16:41:54 user nova-compute[73450]:     <serial type='pty'>
Aug 16 16:41:54 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:54 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:54 user nova-compute[73450]:       <target type='isa-serial' port='0'>
Aug 16 16:41:54 user nova-compute[73450]:         <model name='isa-serial'/>
Aug 16 16:41:54 user nova-compute[73450]:       </target>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </serial>
Aug 16 16:41:54 user nova-compute[73450]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 16:41:54 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:54 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:54 user nova-compute[73450]:       <target type='serial' port='0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </console>
Aug 16 16:41:54 user nova-compute[73450]:     <input type='mouse' bus='ps2'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='input0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </input>
Aug 16 16:41:54 user nova-compute[73450]:     <input type='keyboard' bus='ps2'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='input1'/>
Aug 16 16:41:54 user nova-compute[73450]:     </input>
Aug 16 16:41:54 user nova-compute[73450]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 16:41:54 user nova-compute[73450]:       <listen type='address' address='0.0.0.0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </graphics>
Aug 16 16:41:54 user nova-compute[73450]:     <audio id='1' type='none'/>
Aug 16 16:41:54 user nova-compute[73450]:     <video>
Aug 16 16:41:54 user nova-compute[73450]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='video0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </video>
Aug 16 16:41:54 user nova-compute[73450]:     <memballoon model='virtio'>
Aug 16 16:41:54 user nova-compute[73450]:       <stats period='10'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='balloon0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </memballoon>
Aug 16 16:41:54 user nova-compute[73450]:     <rng model='virtio'>
Aug 16 16:41:54 user nova-compute[73450]:       <backend model='random'>/dev/urandom</backend>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='rng0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </rng>
Aug 16 16:41:54 user nova-compute[73450]:   </devices>
Aug 16 16:41:54 user nova-compute[73450]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 16:41:54 user nova-compute[73450]:     <label>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</label>
Aug 16 16:41:54 user nova-compute[73450]:     <imagelabel>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</imagelabel>
Aug 16 16:41:54 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:54 user nova-compute[73450]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 16:41:54 user nova-compute[73450]:     <label>+64055:+108</label>
Aug 16 16:41:54 user nova-compute[73450]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 16:41:54 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:54 user nova-compute[73450]: </domain>
Aug 16 16:41:54 user nova-compute[73450]:  {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface> {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:7f:07"/><model type="virtio"/><mtu size="1442"/><target dev="tap29b80381-cc"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 16:41:54 user nova-compute[73450]:   <name>instance-00000007</name>
Aug 16 16:41:54 user nova-compute[73450]:   <uuid>408dc4d1-cbe3-4c99-b709-1956d987209a</uuid>
Aug 16 16:41:54 user nova-compute[73450]:   <metadata>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:54 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:53</nova:creationTime>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:54 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:54 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:54 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:54 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:54 user nova-compute[73450]:   </metadata>
Aug 16 16:41:54 user nova-compute[73450]:   <memory unit='KiB'>524288</memory>
Aug 16 16:41:54 user nova-compute[73450]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 16:41:54 user nova-compute[73450]:   <vcpu placement='static'>1</vcpu>
Aug 16 16:41:54 user nova-compute[73450]:   <resource>
Aug 16 16:41:54 user nova-compute[73450]:     <partition>/machine</partition>
Aug 16 16:41:54 user nova-compute[73450]:   </resource>
Aug 16 16:41:54 user nova-compute[73450]:   <sysinfo type='smbios'>
Aug 16 16:41:54 user nova-compute[73450]:     <system>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='version'>0.0.0</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='serial'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='uuid'>408dc4d1-cbe3-4c99-b709-1956d987209a</entry>
Aug 16 16:41:54 user nova-compute[73450]:       <entry name='family'>Virtual Machine</entry>
Aug 16 16:41:54 user nova-compute[73450]:     </system>
Aug 16 16:41:54 user nova-compute[73450]:   </sysinfo>
Aug 16 16:41:54 user nova-compute[73450]:   <os>
Aug 16 16:41:54 user nova-compute[73450]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 16:41:54 user nova-compute[73450]:     <boot dev='hd'/>
Aug 16 16:41:54 user nova-compute[73450]:     <smbios mode='sysinfo'/>
Aug 16 16:41:54 user nova-compute[73450]:   </os>
Aug 16 16:41:54 user nova-compute[73450]:   <features>
Aug 16 16:41:54 user nova-compute[73450]:     <acpi/>
Aug 16 16:41:54 user nova-compute[73450]:     <apic/>
Aug 16 16:41:54 user nova-compute[73450]:     <vmcoreinfo state='on'/>
Aug 16 16:41:54 user nova-compute[73450]:   </features>
Aug 16 16:41:54 user nova-compute[73450]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 16:41:54 user nova-compute[73450]:     <model fallback='forbid'>Nehalem</model>
Aug 16 16:41:54 user nova-compute[73450]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 16:41:54 user nova-compute[73450]:     <feature policy='require' name='vme'/>
Aug 16 16:41:54 user nova-compute[73450]:     <feature policy='require' name='x2apic'/>
Aug 16 16:41:54 user nova-compute[73450]:     <feature policy='require' name='hypervisor'/>
Aug 16 16:41:54 user nova-compute[73450]:   </cpu>
Aug 16 16:41:54 user nova-compute[73450]:   <clock offset='utc'>
Aug 16 16:41:54 user nova-compute[73450]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 16:41:54 user nova-compute[73450]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 16:41:54 user nova-compute[73450]:     <timer name='hpet' present='no'/>
Aug 16 16:41:54 user nova-compute[73450]:   </clock>
Aug 16 16:41:54 user nova-compute[73450]:   <on_poweroff>destroy</on_poweroff>
Aug 16 16:41:54 user nova-compute[73450]:   <on_reboot>restart</on_reboot>
Aug 16 16:41:54 user nova-compute[73450]:   <on_crash>destroy</on_crash>
Aug 16 16:41:54 user nova-compute[73450]:   <devices>
Aug 16 16:41:54 user nova-compute[73450]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 16:41:54 user nova-compute[73450]:     <disk type='file' device='disk'>
Aug 16 16:41:54 user nova-compute[73450]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 16:41:54 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk' index='2'/>
Aug 16 16:41:54 user nova-compute[73450]:       <backingStore type='file' index='3'>
Aug 16 16:41:54 user nova-compute[73450]:         <format type='raw'/>
Aug 16 16:41:54 user nova-compute[73450]:         <source file='/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e'/>
Aug 16 16:41:54 user nova-compute[73450]:         <backingStore/>
Aug 16 16:41:54 user nova-compute[73450]:       </backingStore>
Aug 16 16:41:54 user nova-compute[73450]:       <target dev='vda' bus='virtio'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='virtio-disk0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </disk>
Aug 16 16:41:54 user nova-compute[73450]:     <disk type='file' device='cdrom'>
Aug 16 16:41:54 user nova-compute[73450]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 16:41:54 user nova-compute[73450]:       <source file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk.config' index='1'/>
Aug 16 16:41:54 user nova-compute[73450]:       <backingStore/>
Aug 16 16:41:54 user nova-compute[73450]:       <target dev='hda' bus='ide'/>
Aug 16 16:41:54 user nova-compute[73450]:       <readonly/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='ide0-0-0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </disk>
Aug 16 16:41:54 user nova-compute[73450]:     <controller type='usb' index='0' model='none'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='usb'/>
Aug 16 16:41:54 user nova-compute[73450]:     </controller>
Aug 16 16:41:54 user nova-compute[73450]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='pci.0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </controller>
Aug 16 16:41:54 user nova-compute[73450]:     <controller type='ide' index='0'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='ide'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 16:41:54 user nova-compute[73450]:     </controller>
Aug 16 16:41:54 user nova-compute[73450]:     <interface type='ethernet'>
Aug 16 16:41:54 user nova-compute[73450]:       <mac address='fa:16:3e:83:79:d8'/>
Aug 16 16:41:54 user nova-compute[73450]:       <target dev='tap28373f47-5f'/>
Aug 16 16:41:54 user nova-compute[73450]:       <model type='virtio'/>
Aug 16 16:41:54 user nova-compute[73450]:       <mtu size='1442'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='net0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </interface>
Aug 16 16:41:54 user nova-compute[73450]:     <serial type='pty'>
Aug 16 16:41:54 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:54 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:54 user nova-compute[73450]:       <target type='isa-serial' port='0'>
Aug 16 16:41:54 user nova-compute[73450]:         <model name='isa-serial'/>
Aug 16 16:41:54 user nova-compute[73450]:       </target>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </serial>
Aug 16 16:41:54 user nova-compute[73450]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 16:41:54 user nova-compute[73450]:       <source path='/dev/pts/6'/>
Aug 16 16:41:54 user nova-compute[73450]:       <log file='/opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/console.log' append='off'/>
Aug 16 16:41:54 user nova-compute[73450]:       <target type='serial' port='0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='serial0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </console>
Aug 16 16:41:54 user nova-compute[73450]:     <input type='mouse' bus='ps2'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='input0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </input>
Aug 16 16:41:54 user nova-compute[73450]:     <input type='keyboard' bus='ps2'>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='input1'/>
Aug 16 16:41:54 user nova-compute[73450]:     </input>
Aug 16 16:41:54 user nova-compute[73450]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 16:41:54 user nova-compute[73450]:       <listen type='address' address='0.0.0.0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </graphics>
Aug 16 16:41:54 user nova-compute[73450]:     <audio id='1' type='none'/>
Aug 16 16:41:54 user nova-compute[73450]:     <video>
Aug 16 16:41:54 user nova-compute[73450]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='video0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </video>
Aug 16 16:41:54 user nova-compute[73450]:     <memballoon model='virtio'>
Aug 16 16:41:54 user nova-compute[73450]:       <stats period='10'/>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='balloon0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </memballoon>
Aug 16 16:41:54 user nova-compute[73450]:     <rng model='virtio'>
Aug 16 16:41:54 user nova-compute[73450]:       <backend model='random'>/dev/urandom</backend>
Aug 16 16:41:54 user nova-compute[73450]:       <alias name='rng0'/>
Aug 16 16:41:54 user nova-compute[73450]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 16:41:54 user nova-compute[73450]:     </rng>
Aug 16 16:41:54 user nova-compute[73450]:   </devices>
Aug 16 16:41:54 user nova-compute[73450]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 16:41:54 user nova-compute[73450]:     <label>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</label>
Aug 16 16:41:54 user nova-compute[73450]:     <imagelabel>libvirt-408dc4d1-cbe3-4c99-b709-1956d987209a</imagelabel>
Aug 16 16:41:54 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:54 user nova-compute[73450]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 16:41:54 user nova-compute[73450]:     <label>+64055:+108</label>
Aug 16 16:41:54 user nova-compute[73450]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 16:41:54 user nova-compute[73450]:   </seclabel>
Aug 16 16:41:54 user nova-compute[73450]: </domain>
Aug 16 16:41:54 user nova-compute[73450]:  {{(pid=73450) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 16:41:54 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Detaching interface fa:16:3e:f1:7f:07 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap29b80381-cc' not found.
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.os_vif_util [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Converting VIF {"id": "29b80381-cce8-4301-8960-d836347f6f35", "address": "fa:16:3e:f1:7f:07", "network": {"id": "637bbcaf-5283-4f2f-8d9d-02b20408e9e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-534482055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b80381-cc", "ovs_interfaceid": "29b80381-cce8-4301-8960-d836347f6f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.os_vif_util [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG os_vif [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29b80381-cc, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:41:54 user nova-compute[73450]: INFO os_vif [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=29b80381-cce8-4301-8960-d836347f6f35,network=Network(637bbcaf-5283-4f2f-8d9d-02b20408e9e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b80381-cc')
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [req-9c2f1ab2-101b-4e5e-8d97-2236026dc310 req-086840f2-8adc-43ae-91eb-293080e16397 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:41:54 user nova-compute[73450]:   <nova:package version="0.0.0"/>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:name>tempest-device-tagging-server-1443715549</nova:name>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:creationTime>2023-08-16 16:41:54</nova:creationTime>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:flavor name="m1.tiny">
Aug 16 16:41:54 user nova-compute[73450]:     <nova:memory>512</nova:memory>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:disk>1</nova:disk>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:swap>0</nova:swap>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:vcpus>1</nova:vcpus>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:flavor>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:owner>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:user uuid="7e9fbb80fe4c4693b017e36230b65e85">tempest-TaggedAttachmentsTest-443665424-project-member</nova:user>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:project uuid="5aeededc22ac49fe953a06bc61cb0fec">tempest-TaggedAttachmentsTest-443665424</nova:project>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:owner>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:41:54 user nova-compute[73450]:   <nova:ports>
Aug 16 16:41:54 user nova-compute[73450]:     <nova:port uuid="28373f47-5f2f-4c07-8188-7b3edb9cc645">
Aug 16 16:41:54 user nova-compute[73450]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:41:54 user nova-compute[73450]:     </nova:port>
Aug 16 16:41:54 user nova-compute[73450]:   </nova:ports>
Aug 16 16:41:54 user nova-compute[73450]: </nova:instance>
Aug 16 16:41:54 user nova-compute[73450]:  {{(pid=73450) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [{"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Releasing lock "refresh_cache-408dc4d1-cbe3-4c99-b709-1956d987209a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:41:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cef2df9b-0dad-4d84-8baa-a724368f00aa tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "interface-408dc4d1-cbe3-4c99-b709-1956d987209a-29b80381-cce8-4301-8960-d836347f6f35" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.158s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-eda0fe48-ff45-450c-bfde-43d18aaa809c req-34210810-865c-4cb4-9697-117c207bf0cf service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:41:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-eda0fe48-ff45-450c-bfde-43d18aaa809c req-34210810-865c-4cb4-9697-117c207bf0cf service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:41:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-eda0fe48-ff45-450c-bfde-43d18aaa809c req-34210810-865c-4cb4-9697-117c207bf0cf service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:41:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-eda0fe48-ff45-450c-bfde-43d18aaa809c req-34210810-865c-4cb4-9697-117c207bf0cf service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:41:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-eda0fe48-ff45-450c-bfde-43d18aaa809c req-34210810-865c-4cb4-9697-117c207bf0cf service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:41:55 user nova-compute[73450]: WARNING nova.compute.manager [req-eda0fe48-ff45-450c-bfde-43d18aaa809c req-34210810-865c-4cb4-9697-117c207bf0cf service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-plugged-29b80381-cce8-4301-8960-d836347f6f35 for instance with vm_state active and task_state None.
Aug 16 16:41:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:41:59 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204103.7083113, 032e6ee8-4545-4867-a8ed-4076ed273174 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:41:59 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] VM Stopped (Lifecycle Event)
Aug 16 16:41:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1d635682-4898-4693-ac8f-40a5c46f501a None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:01 user nova-compute[73450]: INFO nova.compute.manager [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Terminating instance
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Instance destroyed successfully.
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lazy-loading 'resources' on Instance uuid a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-74aea215-9a70-48f8-89ee-1cf04afc0226 req-29a98d3e-e18f-45ff-8ac8-42b0f3f02c9d service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-vif-unplugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-74aea215-9a70-48f8-89ee-1cf04afc0226 req-29a98d3e-e18f-45ff-8ac8-42b0f3f02c9d service nova] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-74aea215-9a70-48f8-89ee-1cf04afc0226 req-29a98d3e-e18f-45ff-8ac8-42b0f3f02c9d service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-74aea215-9a70-48f8-89ee-1cf04afc0226 req-29a98d3e-e18f-45ff-8ac8-42b0f3f02c9d service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-74aea215-9a70-48f8-89ee-1cf04afc0226 req-29a98d3e-e18f-45ff-8ac8-42b0f3f02c9d service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] No waiting events found dispatching network-vif-unplugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-74aea215-9a70-48f8-89ee-1cf04afc0226 req-29a98d3e-e18f-45ff-8ac8-42b0f3f02c9d service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-vif-unplugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1779795218',display_name='tempest-VolumesActionsTest-instance-1779795218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1779795218',id=9,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:40:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f20872edf0443fba4ce8818f58855d0',ramdisk_id='',reservation_id='r-32fnxzfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1959607433',owner_user_name='tempest-VolumesActionsTest-1959607433-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:40:01Z,user_data=None,user_id='dc6acf577d674ef1aed6344f82b84947',uuid=a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Converting VIF {"id": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "address": "fa:16:3e:a9:68:92", "network": {"id": "938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1998911543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f20872edf0443fba4ce8818f58855d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac44580d-5f", "ovs_interfaceid": "ac44580d-5f61-4d1a-a57d-a6ec838dd484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG os_vif [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac44580d-5f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:01 user nova-compute[73450]: INFO os_vif [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:68:92,bridge_name='br-int',has_traffic_filtering=True,id=ac44580d-5f61-4d1a-a57d-a6ec838dd484,network=Network(938ed3c4-c6b3-4c1d-a08b-7a011b66f1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac44580d-5f')
Aug 16 16:42:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Deleting instance files /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac_del
Aug 16 16:42:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Deletion of /opt/stack/data/nova/instances/a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac_del complete
Aug 16 16:42:02 user nova-compute[73450]: INFO nova.compute.manager [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 16 16:42:02 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:42:02 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:42:02 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:42:02 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:03 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Took 0.98 seconds to deallocate network for instance.
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:03 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Deleted allocations for instance a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d677989d-a9d6-4610-b29e-e75051155eeb tempest-VolumesActionsTest-1959607433 tempest-VolumesActionsTest-1959607433-project-member] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] Acquiring lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] Lock "a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] No waiting events found dispatching network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:03 user nova-compute[73450]: WARNING nova.compute.manager [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received unexpected event network-vif-plugged-ac44580d-5f61-4d1a-a57d-a6ec838dd484 for instance with vm_state deleted and task_state None.
Aug 16 16:42:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-352f5422-9a88-4f8c-9c0a-d86eb0dc0991 req-47c8f18c-e792-4d58-94f9-fe338f155283 service nova] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Received event network-vif-deleted-ac44580d-5f61-4d1a-a57d-a6ec838dd484 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrtxEviR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f285797-8d8a-4b6f-9f39-c79b71124f69', 'attached_at': '', 'detached_at': '', 'volume_id': '31b703f3-fb0b-411d-a729-10ea8a57eef5', 'serial': '31b703f3-fb0b-411d-a729-10ea8a57eef5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEJfDSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '6f285797-8d8a-4b6f-9f39-c79b71124f69', 'attached_at': '', 'detached_at': '', 'volume_id': '44f5ea9e-edc6-47a3-be04-30326a9f5b73', 'serial'} {{(pid=73450) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrtxEviR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:42:07 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:42:07 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:42:07 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce4bc82-068b-4329-a593-6847e368080f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:42:07 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbceed20-f9a4-4902-a8be-97f0dc73a278]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5] added
Aug 16 16:42:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b452ef52-b416-4427-a2b9-3ab5c5923d34]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[34622307-08e8-46aa-8fbe-9deed5fe6d5d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrtxEviR {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrtxEviR" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3068e9-1ea8-414a-8dc4-147a17908b40]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrtxEviR'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3e826a-04b4-439a-af6d-0894f154fd96]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12956393-afaa-43c0-af07-25c99eef3dbf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bfa41c-4d97-4b7f-9981-ca7c9dc831c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260]
Aug 16 16:42:07 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260] successful.
Aug 16 16:42:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94c58f-96c6-4f17-ae6a-8f8ce9aa0c42]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c618b-fba7-417c-9d18-be25109ca5d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e47ed9-905c-4d2c-a01b-8111b92a5e6b]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrtxEviR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26539366230386635', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539366230386635', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:42:08 user nova-compute[73450]: DEBUG nova.objects.instance [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lazy-loading 'flavor' on Instance uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 85983232 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 261095424 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 432013312 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 600834048 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 939524096 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEJfDSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:42:12 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:42:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193ed3d-4eb9-4ebd-a2b8-cc4131779e09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31401fc-57ce-4863-a572-673e26a76427]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:13 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2702b68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73'): ({'sdk'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Removing single pathed devices sdk {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[47be7270-7248-40ce-9019-fc6ea0b3776e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e977cd-547e-4298-8a43-d916027d70bd]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Flushing IO for device /dev/sdk {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801a409-1fa6-4971-b3b7-b7d8d80a44cf]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1456a75-36fa-4bc8-9810-22a274cf120c]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] SCSI volumes sdk have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a9eb58-003f-4421-b371-f1f0ac4589bc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c2ede-6e46-4466-a424-b2779632133b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260]
Aug 16 16:42:13 user nova-compute[73450]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73, portal: 172.16.0.220,3260] successful.
Aug 16 16:42:13 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[861cec84-fa0c-491a-89eb-76e6ce93168e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] <== disconnect_volume: return (342ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrtxEviR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6f285797-8d8a-4b6f-9f39-c79b71124f69', 'attached_at': '', 'detached_at': '', 'volume_id': '31b703f3-fb0b-411d-a729-10ea8a57eef5', 'serial'} {{(pid=73450) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] swap_volume: removing Cinder connection for volume 44f5ea9e-edc6-47a3-be04-30326a9f5b73 {{(pid=73450) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 16:42:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] swap_volume: Updating volume 44f5ea9e-edc6-47a3-be04-30326a9f5b73 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "FrtxEviR", "auth_password": "s2ZD79nzkMiNUS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "31b703f3-fb0b-411d-a729-10ea8a57eef5"}, "status": "reserved", "instance": "6f285797-8d8a-4b6f-9f39-c79b71124f69", "attached_at": "", "detached_at": "", "volume_id": "31b703f3-fb0b-411d-a729-10ea8a57eef5", "serial": "31b703f3-fb0b-411d-a729-10ea8a57eef5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '31b703f3-fb0b-411d-a729-10ea8a57eef5', 'no_device': None, 'attachment_id': 'b7b4edea-0aa8-4719-84fc-f9bfb1594304'} {{(pid=73450) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 16:42:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-90fa02c0-b755-41cb-b56e-1b323fc0ec6f tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.992s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG os_brick.utils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9247f203-3f06-403f-be81-c0e6c9c8a330]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[581cf8d0-bf7c-40a0-afcc-38a49e31cb8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ceb9df-63d1-4629-8488-9d5028258e9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc59d57c-72e9-4a02-adf7-4fc6deb50562]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:42:15 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:42:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf395995-212c-4899-b2e1-e119293fd3dd]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:42:15 user nova-compute[73450]: DEBUG os_brick.utils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:42:15 user nova-compute[73450]: INFO nova.compute.manager [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Swapping volume 31b703f3-fb0b-411d-a729-10ea8a57eef5 for 44f5ea9e-edc6-47a3-be04-30326a9f5b73
Aug 16 16:42:16 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204121.8798075, a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:16 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] VM Stopped (Lifecycle Event)
Aug 16 16:42:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ad29caa3-e387-4c21-9e97-9f726bee9887 None None] [instance: a7f5ab2f-cbfa-448d-bd51-edbe7692a5ac] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:42:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:22 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:42:22 user nova-compute[73450]: INFO nova.compute.claims [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Claim successful on node user
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.network.neutron [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:42:23 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.policy [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d604d793314808984e92afdc5f5da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad178c8525774ad2a342015b9dc1fbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:42:23 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Creating image(s)
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:42:23 user nova-compute[73450]: INFO nova.compute.claims [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Claim successful on node user
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.207s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk 1073741824" returned: 0 in 0.052s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Cannot resize image /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'migration_context' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Ensure instance console log exists: /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Successfully created port: f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.policy [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d604d793314808984e92afdc5f5da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad178c8525774ad2a342015b9dc1fbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:42:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Creating image(s)
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:42:25 user nova-compute[73450]: INFO nova.compute.claims [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Claim successful on node user
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk 1073741824" returned: 0 in 0.097s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Successfully created port: 40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Successfully updated port: f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-changed-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Refreshing instance network info cache due to event network-changed-f14ce5dd-9557-437f-b006-8749709a9013. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] Acquiring lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Cannot resize image /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'migration_context' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Ensure instance console log exists: /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance network_info: |[{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] Acquired lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.network.neutron [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Refreshing network info cache for port f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Start _get_guest_xml network_info=[{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:42:25 user nova-compute[73450]: DEBUG nova.policy [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb9ce31454384235b35cb8dd1e257364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7478d576cef940d38c222b5e2de1b8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:42:26 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:26 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812468752',display_name='tempest-ServerRescueNegativeTestJSON-server-1812468752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812468752',id=13,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-st8v3bwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:23Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=767812ec-7b5d-414e-ae14-a0bb1ccfb13b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'pci_devices' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:42:26 user nova-compute[73450]:   <uuid>767812ec-7b5d-414e-ae14-a0bb1ccfb13b</uuid>
Aug 16 16:42:26 user nova-compute[73450]:   <name>instance-0000000d</name>
Aug 16 16:42:26 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:42:26 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:42:26 user nova-compute[73450]:   <metadata>
Aug 16 16:42:26 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:42:26 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:42:26 user nova-compute[73450]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1812468752</nova:name>
Aug 16 16:42:26 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:42:26</nova:creationTime>
Aug 16 16:42:26 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:42:26 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:42:26 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:42:26 user nova-compute[73450]:       <nova:owner>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:user uuid="19d604d793314808984e92afdc5f5da0">tempest-ServerRescueNegativeTestJSON-976614040-project-member</nova:user>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:project uuid="ad178c8525774ad2a342015b9dc1fbf2">tempest-ServerRescueNegativeTestJSON-976614040</nova:project>
Aug 16 16:42:26 user nova-compute[73450]:       </nova:owner>
Aug 16 16:42:26 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:42:26 user nova-compute[73450]:       <nova:ports>
Aug 16 16:42:26 user nova-compute[73450]:         <nova:port uuid="f14ce5dd-9557-437f-b006-8749709a9013">
Aug 16 16:42:26 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:42:26 user nova-compute[73450]:         </nova:port>
Aug 16 16:42:26 user nova-compute[73450]:       </nova:ports>
Aug 16 16:42:26 user nova-compute[73450]:     </nova:instance>
Aug 16 16:42:26 user nova-compute[73450]:   </metadata>
Aug 16 16:42:26 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:42:26 user nova-compute[73450]:     <system>
Aug 16 16:42:26 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:42:26 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:42:26 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:42:26 user nova-compute[73450]:       <entry name="serial">767812ec-7b5d-414e-ae14-a0bb1ccfb13b</entry>
Aug 16 16:42:26 user nova-compute[73450]:       <entry name="uuid">767812ec-7b5d-414e-ae14-a0bb1ccfb13b</entry>
Aug 16 16:42:26 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:42:26 user nova-compute[73450]:     </system>
Aug 16 16:42:26 user nova-compute[73450]:   </sysinfo>
Aug 16 16:42:26 user nova-compute[73450]:   <os>
Aug 16 16:42:26 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:42:26 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:42:26 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:42:26 user nova-compute[73450]:   </os>
Aug 16 16:42:26 user nova-compute[73450]:   <features>
Aug 16 16:42:26 user nova-compute[73450]:     <acpi/>
Aug 16 16:42:26 user nova-compute[73450]:     <apic/>
Aug 16 16:42:26 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:42:26 user nova-compute[73450]:   </features>
Aug 16 16:42:26 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:42:26 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:42:26 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:42:26 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:42:26 user nova-compute[73450]:   </clock>
Aug 16 16:42:26 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:42:26 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:42:26 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:42:26 user nova-compute[73450]:   </cpu>
Aug 16 16:42:26 user nova-compute[73450]:   <devices>
Aug 16 16:42:26 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:42:26 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:42:26 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk"/>
Aug 16 16:42:26 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:42:26 user nova-compute[73450]:     </disk>
Aug 16 16:42:26 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:42:26 user nova-compute[73450]:       <mac address="fa:16:3e:93:4b:c7"/>
Aug 16 16:42:26 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:26 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:42:26 user nova-compute[73450]:       <target dev="tapf14ce5dd-95"/>
Aug 16 16:42:26 user nova-compute[73450]:     </interface>
Aug 16 16:42:26 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:42:26 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/console.log" append="off"/>
Aug 16 16:42:26 user nova-compute[73450]:     </serial>
Aug 16 16:42:26 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:42:26 user nova-compute[73450]:     <video>
Aug 16 16:42:26 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:26 user nova-compute[73450]:     </video>
Aug 16 16:42:26 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:42:26 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:42:26 user nova-compute[73450]:     </rng>
Aug 16 16:42:26 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:42:26 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:42:26 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:42:26 user nova-compute[73450]:     </memballoon>
Aug 16 16:42:26 user nova-compute[73450]:   </devices>
Aug 16 16:42:26 user nova-compute[73450]: </domain>
Aug 16 16:42:26 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812468752',display_name='tempest-ServerRescueNegativeTestJSON-server-1812468752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812468752',id=13,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-st8v3bwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:23Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=767812ec-7b5d-414e-ae14-a0bb1ccfb13b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG os_vif [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf14ce5dd-95, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf14ce5dd-95, col_values=(('external_ids', {'iface-id': 'f14ce5dd-9557-437f-b006-8749709a9013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:4b:c7', 'vm-uuid': '767812ec-7b5d-414e-ae14-a0bb1ccfb13b'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:26 user nova-compute[73450]: INFO os_vif [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95')
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:93:4b:c7, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:42:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Creating image(s)
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "/opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "/opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "/opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.246s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk 1073741824" returned: 0 in 0.078s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "86049569-07b7-43dc-98b9-796174986401" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "86049569-07b7-43dc-98b9-796174986401" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "86049569-07b7-43dc-98b9-796174986401-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "86049569-07b7-43dc-98b9-796174986401-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "86049569-07b7-43dc-98b9-796174986401-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:26 user nova-compute[73450]: INFO nova.compute.manager [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Terminating instance
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Successfully updated port: 40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-changed-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Refreshing instance network info cache due to event network-changed-40122be5-d72a-4bef-8bbd-4899062d67fa. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] Acquiring lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] Acquired lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Refreshing network info cache for port 40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.219s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:42:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updated VIF entry in instance network info cache for port f14ce5dd-9557-437f-b006-8749709a9013. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b79c7f2-b158-4a09-bc29-e0084e5a17d3 req-9e457d21-2788-41aa-aa25-6cb2ad7582cc service nova] Releasing lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Cannot resize image /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'migration_context' on Instance uuid 91abba0d-17da-4d78-8e2b-b3b741e465d5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Ensure instance console log exists: /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Successfully created port: bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3686f2d3-ebfa-4ace-b430-a12e490568fb req-c8623c4d-e76c-49b9-b296-1a3da1dcbc01 service nova] Releasing lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-vif-unplugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] Acquiring lock "86049569-07b7-43dc-98b9-796174986401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] No waiting events found dispatching network-vif-unplugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-vif-unplugged-921473b6-0483-4b8e-9aef-abf159c2337c for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] Acquiring lock "86049569-07b7-43dc-98b9-796174986401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] Lock "86049569-07b7-43dc-98b9-796174986401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] No waiting events found dispatching network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:27 user nova-compute[73450]: WARNING nova.compute.manager [req-bb61bc67-673d-4f62-b82c-3acf91ae7d24 req-05f29c03-01ac-4f04-b6cf-0a09fe9627ca service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received unexpected event network-vif-plugged-921473b6-0483-4b8e-9aef-abf159c2337c for instance with vm_state active and task_state deleting.
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG nova.network.neutron [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 86049569-07b7-43dc-98b9-796174986401] Instance destroyed successfully.
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.objects.instance [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lazy-loading 'resources' on Instance uuid 86049569-07b7-43dc-98b9-796174986401 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-536210619',display_name='tempest-ServersNegativeTestJSON-server-536210619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-536210619',id=12,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:40:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e78ad8f16dae4525b9aecc767f42a261',ramdisk_id='',reservation_id='r-77pb03tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1651503421',owner_user_name='tempest-ServersNegativeTestJSON-1651503421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:40:45Z,user_data=None,user_id='b725deabeb954813950dc1841e6a09fc',uuid=86049569-07b7-43dc-98b9-796174986401,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converting VIF {"id": "921473b6-0483-4b8e-9aef-abf159c2337c", "address": "fa:16:3e:bd:d0:77", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921473b6-04", "ovs_interfaceid": "921473b6-0483-4b8e-9aef-abf159c2337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG os_vif [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap921473b6-04, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:28 user nova-compute[73450]: INFO os_vif [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d0:77,bridge_name='br-int',has_traffic_filtering=True,id=921473b6-0483-4b8e-9aef-abf159c2337c,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921473b6-04')
Aug 16 16:42:28 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Deleting instance files /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401_del
Aug 16 16:42:28 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Deletion of /opt/stack/data/nova/instances/86049569-07b7-43dc-98b9-796174986401_del complete
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: INFO nova.compute.manager [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 86049569-07b7-43dc-98b9-796174986401] Took 1.51 seconds to destroy the instance on the hypervisor.
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 86049569-07b7-43dc-98b9-796174986401] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 86049569-07b7-43dc-98b9-796174986401] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.neutron [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance network_info: |[{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Start _get_guest_xml network_info=[{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:42:28 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:28 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-237743492',display_name='tempest-ServerRescueNegativeTestJSON-server-237743492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-237743492',id=14,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-5z2ybtij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:25Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=d1731c4d-0c63-4394-b50e-2db9c23a6951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.objects.instance [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'pci_devices' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:42:28 user nova-compute[73450]:   <uuid>d1731c4d-0c63-4394-b50e-2db9c23a6951</uuid>
Aug 16 16:42:28 user nova-compute[73450]:   <name>instance-0000000e</name>
Aug 16 16:42:28 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:42:28 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:42:28 user nova-compute[73450]:   <metadata>
Aug 16 16:42:28 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:42:28 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:42:28 user nova-compute[73450]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-237743492</nova:name>
Aug 16 16:42:28 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:42:28</nova:creationTime>
Aug 16 16:42:28 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:42:28 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:42:28 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:42:28 user nova-compute[73450]:       <nova:owner>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:user uuid="19d604d793314808984e92afdc5f5da0">tempest-ServerRescueNegativeTestJSON-976614040-project-member</nova:user>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:project uuid="ad178c8525774ad2a342015b9dc1fbf2">tempest-ServerRescueNegativeTestJSON-976614040</nova:project>
Aug 16 16:42:28 user nova-compute[73450]:       </nova:owner>
Aug 16 16:42:28 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:42:28 user nova-compute[73450]:       <nova:ports>
Aug 16 16:42:28 user nova-compute[73450]:         <nova:port uuid="40122be5-d72a-4bef-8bbd-4899062d67fa">
Aug 16 16:42:28 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:42:28 user nova-compute[73450]:         </nova:port>
Aug 16 16:42:28 user nova-compute[73450]:       </nova:ports>
Aug 16 16:42:28 user nova-compute[73450]:     </nova:instance>
Aug 16 16:42:28 user nova-compute[73450]:   </metadata>
Aug 16 16:42:28 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:42:28 user nova-compute[73450]:     <system>
Aug 16 16:42:28 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:42:28 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:42:28 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:42:28 user nova-compute[73450]:       <entry name="serial">d1731c4d-0c63-4394-b50e-2db9c23a6951</entry>
Aug 16 16:42:28 user nova-compute[73450]:       <entry name="uuid">d1731c4d-0c63-4394-b50e-2db9c23a6951</entry>
Aug 16 16:42:28 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:42:28 user nova-compute[73450]:     </system>
Aug 16 16:42:28 user nova-compute[73450]:   </sysinfo>
Aug 16 16:42:28 user nova-compute[73450]:   <os>
Aug 16 16:42:28 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:42:28 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:42:28 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:42:28 user nova-compute[73450]:   </os>
Aug 16 16:42:28 user nova-compute[73450]:   <features>
Aug 16 16:42:28 user nova-compute[73450]:     <acpi/>
Aug 16 16:42:28 user nova-compute[73450]:     <apic/>
Aug 16 16:42:28 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:42:28 user nova-compute[73450]:   </features>
Aug 16 16:42:28 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:42:28 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:42:28 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:42:28 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:42:28 user nova-compute[73450]:   </clock>
Aug 16 16:42:28 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:42:28 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:42:28 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:42:28 user nova-compute[73450]:   </cpu>
Aug 16 16:42:28 user nova-compute[73450]:   <devices>
Aug 16 16:42:28 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:42:28 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:42:28 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk"/>
Aug 16 16:42:28 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:42:28 user nova-compute[73450]:     </disk>
Aug 16 16:42:28 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:42:28 user nova-compute[73450]:       <mac address="fa:16:3e:e0:87:92"/>
Aug 16 16:42:28 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:28 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:42:28 user nova-compute[73450]:       <target dev="tap40122be5-d7"/>
Aug 16 16:42:28 user nova-compute[73450]:     </interface>
Aug 16 16:42:28 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:42:28 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/console.log" append="off"/>
Aug 16 16:42:28 user nova-compute[73450]:     </serial>
Aug 16 16:42:28 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:42:28 user nova-compute[73450]:     <video>
Aug 16 16:42:28 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:28 user nova-compute[73450]:     </video>
Aug 16 16:42:28 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:42:28 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:42:28 user nova-compute[73450]:     </rng>
Aug 16 16:42:28 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:42:28 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:42:28 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:42:28 user nova-compute[73450]:     </memballoon>
Aug 16 16:42:28 user nova-compute[73450]:   </devices>
Aug 16 16:42:28 user nova-compute[73450]: </domain>
Aug 16 16:42:28 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-237743492',display_name='tempest-ServerRescueNegativeTestJSON-server-237743492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-237743492',id=14,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-5z2ybtij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:25Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=d1731c4d-0c63-4394-b50e-2db9c23a6951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG os_vif [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40122be5-d7, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40122be5-d7, col_values=(('external_ids', {'iface-id': '40122be5-d72a-4bef-8bbd-4899062d67fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:87:92', 'vm-uuid': 'd1731c4d-0c63-4394-b50e-2db9c23a6951'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: INFO os_vif [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7')
Aug 16 16:42:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:e0:87:92, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Successfully updated port: bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 86049569-07b7-43dc-98b9-796174986401] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "refresh_cache-91abba0d-17da-4d78-8e2b-b3b741e465d5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquired lock "refresh_cache-91abba0d-17da-4d78-8e2b-b3b741e465d5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:42:28 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 86049569-07b7-43dc-98b9-796174986401] Took 0.61 seconds to deallocate network for instance.
Aug 16 16:42:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:29 user nova-compute[73450]: WARNING nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state building and task_state spawning.
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:29 user nova-compute[73450]: WARNING nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state building and task_state spawning.
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-changed-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Refreshing instance network info cache due to event network-changed-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Acquiring lock "refresh_cache-91abba0d-17da-4d78-8e2b-b3b741e465d5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-a138e7e3-4811-4705-af33-022914bbd090 req-5231f846-e89c-4282-902b-ee48981390b1 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event volume-reimaged-271210ae-b56b-4e19-a04a-c53c352dd3a9 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a138e7e3-4811-4705-af33-022914bbd090 req-5231f846-e89c-4282-902b-ee48981390b1 service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a138e7e3-4811-4705-af33-022914bbd090 req-5231f846-e89c-4282-902b-ee48981390b1 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a138e7e3-4811-4705-af33-022914bbd090 req-5231f846-e89c-4282-902b-ee48981390b1 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-a138e7e3-4811-4705-af33-022914bbd090 req-5231f846-e89c-4282-902b-ee48981390b1 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Processing event volume-reimaged-271210ae-b56b-4e19-a04a-c53c352dd3a9 {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance event wait completed in 39 seconds for volume-reimaged {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:42:29 user nova-compute[73450]: INFO nova.virt.block_device [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Booting with volume 271210ae-b56b-4e19-a04a-c53c352dd3a9 at /dev/vda
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_brick.utils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907d859-0597-4424-af99-fb30eaa3ce3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c1cb3-5ce4-417e-a9c3-ae9fd432e0da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Updating instance_info_cache with network_info: [{"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae375385-4aad-4b02-b70a-2c4893954dab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f1c6a9-0c0c-4264-8162-5896471402ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Releasing lock "refresh_cache-91abba0d-17da-4d78-8e2b-b3b741e465d5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Instance network_info: |[{"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Acquired lock "refresh_cache-91abba0d-17da-4d78-8e2b-b3b741e465d5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Refreshing network info cache for port bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Start _get_guest_xml network_info=[{"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:42:29 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cff614-7861-4ce1-a5c6-060212cc5b32]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_brick.utils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updating existing volume attachment record: 422591f0-e993-4a36-ab3c-6b66909812db {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:42:29 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:29 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-694310296',display_name='tempest-VolumesAdminNegativeTest-server-694310296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-694310296',id=15,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7478d576cef940d38c222b5e2de1b8f0',ramdisk_id='',reservation_id='r-7wz28lal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1290942672',owner_user_name='tempest-VolumesAdminNegativeTest-1290942672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:26Z,user_data=None,user_id='bb9ce31454384235b35cb8dd1e257364',uuid=91abba0d-17da-4d78-8e2b-b3b741e465d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converting VIF {"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'pci_devices' on Instance uuid 91abba0d-17da-4d78-8e2b-b3b741e465d5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:42:29 user nova-compute[73450]:   <uuid>91abba0d-17da-4d78-8e2b-b3b741e465d5</uuid>
Aug 16 16:42:29 user nova-compute[73450]:   <name>instance-0000000f</name>
Aug 16 16:42:29 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:42:29 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:42:29 user nova-compute[73450]:   <metadata>
Aug 16 16:42:29 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:42:29 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:42:29 user nova-compute[73450]:       <nova:name>tempest-VolumesAdminNegativeTest-server-694310296</nova:name>
Aug 16 16:42:29 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:42:29</nova:creationTime>
Aug 16 16:42:29 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:42:29 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:42:29 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:42:29 user nova-compute[73450]:       <nova:owner>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:user uuid="bb9ce31454384235b35cb8dd1e257364">tempest-VolumesAdminNegativeTest-1290942672-project-member</nova:user>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:project uuid="7478d576cef940d38c222b5e2de1b8f0">tempest-VolumesAdminNegativeTest-1290942672</nova:project>
Aug 16 16:42:29 user nova-compute[73450]:       </nova:owner>
Aug 16 16:42:29 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:42:29 user nova-compute[73450]:       <nova:ports>
Aug 16 16:42:29 user nova-compute[73450]:         <nova:port uuid="bef8e556-a5d2-4c37-b9cd-aed76dc39ef1">
Aug 16 16:42:29 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:42:29 user nova-compute[73450]:         </nova:port>
Aug 16 16:42:29 user nova-compute[73450]:       </nova:ports>
Aug 16 16:42:29 user nova-compute[73450]:     </nova:instance>
Aug 16 16:42:29 user nova-compute[73450]:   </metadata>
Aug 16 16:42:29 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:42:29 user nova-compute[73450]:     <system>
Aug 16 16:42:29 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:42:29 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:42:29 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:42:29 user nova-compute[73450]:       <entry name="serial">91abba0d-17da-4d78-8e2b-b3b741e465d5</entry>
Aug 16 16:42:29 user nova-compute[73450]:       <entry name="uuid">91abba0d-17da-4d78-8e2b-b3b741e465d5</entry>
Aug 16 16:42:29 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:42:29 user nova-compute[73450]:     </system>
Aug 16 16:42:29 user nova-compute[73450]:   </sysinfo>
Aug 16 16:42:29 user nova-compute[73450]:   <os>
Aug 16 16:42:29 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:42:29 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:42:29 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:42:29 user nova-compute[73450]:   </os>
Aug 16 16:42:29 user nova-compute[73450]:   <features>
Aug 16 16:42:29 user nova-compute[73450]:     <acpi/>
Aug 16 16:42:29 user nova-compute[73450]:     <apic/>
Aug 16 16:42:29 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:42:29 user nova-compute[73450]:   </features>
Aug 16 16:42:29 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:42:29 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:42:29 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:42:29 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:42:29 user nova-compute[73450]:   </clock>
Aug 16 16:42:29 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:42:29 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:42:29 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:42:29 user nova-compute[73450]:   </cpu>
Aug 16 16:42:29 user nova-compute[73450]:   <devices>
Aug 16 16:42:29 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:42:29 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:42:29 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk"/>
Aug 16 16:42:29 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:42:29 user nova-compute[73450]:     </disk>
Aug 16 16:42:29 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:42:29 user nova-compute[73450]:       <mac address="fa:16:3e:21:06:16"/>
Aug 16 16:42:29 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:29 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:42:29 user nova-compute[73450]:       <target dev="tapbef8e556-a5"/>
Aug 16 16:42:29 user nova-compute[73450]:     </interface>
Aug 16 16:42:29 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:42:29 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/console.log" append="off"/>
Aug 16 16:42:29 user nova-compute[73450]:     </serial>
Aug 16 16:42:29 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:42:29 user nova-compute[73450]:     <video>
Aug 16 16:42:29 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:29 user nova-compute[73450]:     </video>
Aug 16 16:42:29 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:42:29 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:42:29 user nova-compute[73450]:     </rng>
Aug 16 16:42:29 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:42:29 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:42:29 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:42:29 user nova-compute[73450]:     </memballoon>
Aug 16 16:42:29 user nova-compute[73450]:   </devices>
Aug 16 16:42:29 user nova-compute[73450]: </domain>
Aug 16 16:42:29 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-694310296',display_name='tempest-VolumesAdminNegativeTest-server-694310296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-694310296',id=15,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7478d576cef940d38c222b5e2de1b8f0',ramdisk_id='',reservation_id='r-7wz28lal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1290942672',owner_user_name='tempest-VolumesAdminNegativeTest-1290942672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:26Z,user_data=None,user_id='bb9ce31454384235b35cb8dd1e257364',uuid=91abba0d-17da-4d78-8e2b-b3b741e465d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converting VIF {"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG os_vif [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef8e556-a5, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbef8e556-a5, col_values=(('external_ids', {'iface-id': 'bef8e556-a5d2-4c37-b9cd-aed76dc39ef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:06:16', 'vm-uuid': '91abba0d-17da-4d78-8e2b-b3b741e465d5'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-a4d04a71-f2c5-479c-8666-1cdecdb365f9 req-a270b3f5-99ec-4b22-9825-713feb308cde service nova] [instance: 86049569-07b7-43dc-98b9-796174986401] Received event network-vif-deleted-921473b6-0483-4b8e-9aef-abf159c2337c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:29 user nova-compute[73450]: INFO os_vif [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5')
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.673s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] No VIF found with MAC fa:16:3e:21:06:16, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:42:29 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Deleted allocations for instance 86049569-07b7-43dc-98b9-796174986401
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fdd6d9e1-66f1-474a-b208-92b27b9ae621 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "86049569-07b7-43dc-98b9-796174986401" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.040s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Updated VIF entry in instance network info cache for port bef8e556-a5d2-4c37-b9cd-aed76dc39ef1. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Updating instance_info_cache with network_info: [{"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1c82df30-043c-40d3-bf78-fe1a23e886c8 req-76051203-8ae9-4932-8d7b-16a88d1852ce service nova] Releasing lock "refresh_cache-91abba0d-17da-4d78-8e2b-b3b741e465d5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204150.1551714, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Resumed (Lifecycle Event)
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance spawned successfully.
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204150.156572, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Started (Lifecycle Event)
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 16 16:42:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:30 user nova-compute[73450]: INFO nova.compute.manager [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Took 7.79 seconds to build instance.
Aug 16 16:42:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-527be678-d2dc-451d-9821-59a91811bf21 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.885s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:31 user nova-compute[73450]: WARNING nova.compute.manager [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state building and task_state spawning.
Aug 16 16:42:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:31 user nova-compute[73450]: WARNING nova.compute.manager [req-0c44406a-1111-46ae-b2a4-96ad668cea52 req-92c7d9b7-ca27-4b75-b5df-47932f8111db service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state building and task_state spawning.
Aug 16 16:42:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-ec6ca914-3546-4a71-a8b6-bce138cf37da req-f1aed683-fd9f-4e7c-8bf0-f1ca26e4eb5f service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ec6ca914-3546-4a71-a8b6-bce138cf37da req-f1aed683-fd9f-4e7c-8bf0-f1ca26e4eb5f service nova] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ec6ca914-3546-4a71-a8b6-bce138cf37da req-f1aed683-fd9f-4e7c-8bf0-f1ca26e4eb5f service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ec6ca914-3546-4a71-a8b6-bce138cf37da req-f1aed683-fd9f-4e7c-8bf0-f1ca26e4eb5f service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-ec6ca914-3546-4a71-a8b6-bce138cf37da req-f1aed683-fd9f-4e7c-8bf0-f1ca26e4eb5f service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] No waiting events found dispatching network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:32 user nova-compute[73450]: WARNING nova.compute.manager [req-ec6ca914-3546-4a71-a8b6-bce138cf37da req-f1aed683-fd9f-4e7c-8bf0-f1ca26e4eb5f service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received unexpected event network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 for instance with vm_state building and task_state spawning.
Aug 16 16:42:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204153.6948056, d1731c4d-0c63-4394-b50e-2db9c23a6951 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] VM Resumed (Lifecycle Event)
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance spawned successfully.
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204153.6977503, d1731c4d-0c63-4394-b50e-2db9c23a6951 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] VM Started (Lifecycle Event)
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Took 9.20 seconds to spawn the instance on the hypervisor.
Aug 16 16:42:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:33 user nova-compute[73450]: INFO nova.compute.manager [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Took 10.44 seconds to build instance.
Aug 16 16:42:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-56edbe8e-6988-4ed4-87aa-f4f96193cf2d tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.546s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204154.0684028, 91abba0d-17da-4d78-8e2b-b3b741e465d5 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] VM Resumed (Lifecycle Event)
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Instance spawned successfully.
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4056204-68df-43e2-a7c0-d1a5491de210 req-eaa55a5c-87d5-4999-b255-6fc2bc21d5e9 service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4056204-68df-43e2-a7c0-d1a5491de210 req-eaa55a5c-87d5-4999-b255-6fc2bc21d5e9 service nova] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4056204-68df-43e2-a7c0-d1a5491de210 req-eaa55a5c-87d5-4999-b255-6fc2bc21d5e9 service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4056204-68df-43e2-a7c0-d1a5491de210 req-eaa55a5c-87d5-4999-b255-6fc2bc21d5e9 service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4056204-68df-43e2-a7c0-d1a5491de210 req-eaa55a5c-87d5-4999-b255-6fc2bc21d5e9 service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] No waiting events found dispatching network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:34 user nova-compute[73450]: WARNING nova.compute.manager [req-f4056204-68df-43e2-a7c0-d1a5491de210 req-eaa55a5c-87d5-4999-b255-6fc2bc21d5e9 service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received unexpected event network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 for instance with vm_state building and task_state spawning.
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204154.0714602, 91abba0d-17da-4d78-8e2b-b3b741e465d5 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] VM Started (Lifecycle Event)
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Took 9.32 seconds to build instance.
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5468cc66-077b-40b5-84bc-7762ed01bea9 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.443s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:34 user nova-compute[73450]: INFO nova.compute.manager [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Terminating instance
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-dca95685-3b1f-4675-9c32-645023ad6bf6 req-448ceb98-c4c7-47c2-a773-c701d4eb150b service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-vif-unplugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dca95685-3b1f-4675-9c32-645023ad6bf6 req-448ceb98-c4c7-47c2-a773-c701d4eb150b service nova] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dca95685-3b1f-4675-9c32-645023ad6bf6 req-448ceb98-c4c7-47c2-a773-c701d4eb150b service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dca95685-3b1f-4675-9c32-645023ad6bf6 req-448ceb98-c4c7-47c2-a773-c701d4eb150b service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-dca95685-3b1f-4675-9c32-645023ad6bf6 req-448ceb98-c4c7-47c2-a773-c701d4eb150b service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] No waiting events found dispatching network-vif-unplugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-dca95685-3b1f-4675-9c32-645023ad6bf6 req-448ceb98-c4c7-47c2-a773-c701d4eb150b service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-vif-unplugged-69fbeea4-4203-4f15-85a8-5be48915e06d for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:42:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Instance destroyed successfully.
Aug 16 16:42:35 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lazy-loading 'resources' on Instance uuid 816ac70d-0ed7-4bf0-ae30-f265f7889221 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-278790643',display_name='tempest-VolumesAssistedSnapshotsTest-server-278790643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-278790643',id=4,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKM+fEuBOjDPnznKqDlYMJeytvqSYxUVuJnfYfyrKM6Olkhj8pEptwdOsQGDevZnY1aqF1gsg04q0jLUzIuHBZmvdwPCbaDYlHn9AqyhwR7Sf/oIvoIopzhMMatf5DzblA==',key_name='tempest-keypair-1040848914',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8273d8b0ea47daad0ea34b03caa47d',ramdisk_id='',reservation_id='r-3qgajwwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-767903908',owner_user_name='tempest-VolumesAssistedSnapshotsTest-767903908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666e97bbda244efacbb351870c8bb30',uuid=816ac70d-0ed7-4bf0-ae30-f265f7889221,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Converting VIF {"id": "69fbeea4-4203-4f15-85a8-5be48915e06d", "address": "fa:16:3e:0c:87:78", "network": {"id": "5b0db071-65fa-4938-9792-c4feeee22df4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1981476244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8273d8b0ea47daad0ea34b03caa47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fbeea4-42", "ovs_interfaceid": "69fbeea4-4203-4f15-85a8-5be48915e06d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG os_vif [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69fbeea4-42, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:35 user nova-compute[73450]: INFO os_vif [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:87:78,bridge_name='br-int',has_traffic_filtering=True,id=69fbeea4-4203-4f15-85a8-5be48915e06d,network=Network(5b0db071-65fa-4938-9792-c4feeee22df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fbeea4-42')
Aug 16 16:42:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Deleting instance files /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221_del
Aug 16 16:42:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Deletion of /opt/stack/data/nova/instances/816ac70d-0ed7-4bf0-ae30-f265f7889221_del complete
Aug 16 16:42:35 user nova-compute[73450]: INFO nova.compute.manager [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 16 16:42:35 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:42:35 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:36 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Took 1.13 seconds to deallocate network for instance.
Aug 16 16:42:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] Acquiring lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] No waiting events found dispatching network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:36 user nova-compute[73450]: WARNING nova.compute.manager [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received unexpected event network-vif-plugged-69fbeea4-4203-4f15-85a8-5be48915e06d for instance with vm_state deleted and task_state None.
Aug 16 16:42:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-e553e6c4-928b-48f1-8020-90c8698cea4e req-83626434-3d77-4984-9b72-6f023d76ce97 service nova] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Received event network-vif-deleted-69fbeea4-4203-4f15-85a8-5be48915e06d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:37 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Deleted allocations for instance 816ac70d-0ed7-4bf0-ae30-f265f7889221
Aug 16 16:42:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6bcea919-74ff-4a8a-98c4-ab7a892da743 tempest-VolumesAssistedSnapshotsTest-767903908 tempest-VolumesAssistedSnapshotsTest-767903908-project-member] Lock "816ac70d-0ed7-4bf0-ae30-f265f7889221" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.136s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.volume.cinder [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Update attachment failed for attachment 3692a262-e796-45ad-8c0c-c380c8934bf5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 was not found.).). (HTTP 500) (Request-ID: req-abd704b0-a73c-4574-92b0-2a59d438ba31) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 was not found.).). (HTTP 500) (Request-ID: req-abd704b0-a73c-4574-92b0-2a59d438ba31)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Failed to connect to volume 44f5ea9e-edc6-47a3-be04-30326a9f5b73 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 was not found.).). (HTTP 500) (Request-ID: req-abd704b0-a73c-4574-92b0-2a59d438ba31)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Traceback (most recent call last):
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     new_cinfo = self.volume_api.attachment_update(
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     res = method(self, ctx, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     with excutils.save_and_reraise_exception():
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     self.force_reraise()
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     raise self.value
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     return method.func(obj, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     resp = self._update('/attachments/%s' % id, body)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     return self.request(url, method, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69]     raise exceptions.from_response(resp, body)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 was not found.).). (HTTP 500) (Request-ID: req-abd704b0-a73c-4574-92b0-2a59d438ba31)
Aug 16 16:42:40 user nova-compute[73450]: ERROR nova.compute.manager [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] 
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 24.727s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server [None req-29a373a3-463e-43a0-b798-0a943baa4d34 tempest-TestVolumeSwap-1773056223 tempest-TestVolumeSwap-1773056223-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 was not found.).). (HTTP 500) (Request-ID: req-abd704b0-a73c-4574-92b0-2a59d438ba31)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:44f5ea9e-edc6-47a3-be04-30326a9f5b73/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 was not found.).). (HTTP 500) (Request-ID: req-abd704b0-a73c-4574-92b0-2a59d438ba31)
Aug 16 16:42:40 user nova-compute[73450]: ERROR oslo_messaging.rpc.server 
Aug 16 16:42:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204148.1845603, 86049569-07b7-43dc-98b9-796174986401 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:43 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 86049569-07b7-43dc-98b9-796174986401] VM Stopped (Lifecycle Event)
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7fba9de7-8778-4c84-8d3a-67bf802130b7 None None] [instance: 86049569-07b7-43dc-98b9-796174986401] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:42:43 user nova-compute[73450]: INFO nova.compute.claims [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Claim successful on node user
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:43 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:43 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7388MB free_disk=24.46004867553711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:43 user nova-compute[73450]: INFO nova.compute.manager [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Terminating instance
Aug 16 16:42:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Creating image(s)
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Ensure instance console log exists: /opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Start _get_guest_xml network_info=[{"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '422591f0-e993-4a36-ab3c-6b66909812db', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '032e6ee8-4545-4867-a8ed-4076ed273174', 'attached_at': '', 'detached_at': '', 'volume_id': '271210ae-b56b-4e19-a04a-c53c352dd3a9', 'serial': '271210ae-b56b-4e19-a04a-c53c352dd3a9'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 16:42:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'vcpu_model' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:42:44 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:42:44 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:42:44 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[17af11e2-0cba-4b02-869d-e21ec9a4910c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:42:44 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ac75b1-c737-4a3b-a015-aa368642f9a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9] added
Aug 16 16:42:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c170c9-1dc8-4bd6-88b8-899b31ed185f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5695e876-4947-4ce9-b36a-22dcb453a7ce]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vOLdAwYH {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vOLdAwYH" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76e9781-4603-47d8-931b-7918c8bb7b9d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vOLdAwYH'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213ce9b-2c67-4dba-97d2-2d95dd63f5d4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-90c75dd0-0c55-4f33-9055-45ed65aa045f req-5a915465-3902-4818-9d2b-7913ef614e6a service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-unplugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-90c75dd0-0c55-4f33-9055-45ed65aa045f req-5a915465-3902-4818-9d2b-7913ef614e6a service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-90c75dd0-0c55-4f33-9055-45ed65aa045f req-5a915465-3902-4818-9d2b-7913ef614e6a service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-90c75dd0-0c55-4f33-9055-45ed65aa045f req-5a915465-3902-4818-9d2b-7913ef614e6a service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-90c75dd0-0c55-4f33-9055-45ed65aa045f req-5a915465-3902-4818-9d2b-7913ef614e6a service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-unplugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-90c75dd0-0c55-4f33-9055-45ed65aa045f req-5a915465-3902-4818-9d2b-7913ef614e6a service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-unplugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bb8f1-34ac-4d90-8ef4-e98e1648096d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.683s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.159s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5166c-4401-4ec4-b89f-39ee035860cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]
Aug 16 16:42:44 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.
Aug 16 16:42:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f18901-d712-40d4-a1a2-d89023d4f148]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3744e0a-49c5-4224-aaba-c4e7ac394a4e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:42:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a7c39-8417-4e81-be97-ca40ad86c2d2]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Instance destroyed successfully.
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lazy-loading 'resources' on Instance uuid 408dc4d1-cbe3-4c99-b709-1956d987209a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443715549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443715549',id=7,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzC+j2FraN55BvlVzuRN6MwJ4fX6oWMrhwtqCTJdAAKP4b4Fqg8/4GVLtn1cTr7JIDEAS2kmHV+Lp0PohuqwpZFOH9g9ca5jMj5i54DEWi8MiFGMSF/8SgewjS6qmazfw==',key_name='tempest-keypair-542168799',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aeededc22ac49fe953a06bc61cb0fec',ramdisk_id='',reservation_id='r-ziio3z4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-443665424',owner_user_name='tempest-TaggedAttachmentsTest-443665424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e9fbb80fe4c4693b017e36230b65e85',uuid=408dc4d1-cbe3-4c99-b709-1956d987209a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converting VIF {"id": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "address": "fa:16:3e:83:79:d8", "network": {"id": "7095fc2a-f23e-41a0-a951-c44cfa06b6ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1742286778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aeededc22ac49fe953a06bc61cb0fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28373f47-5f", "ovs_interfaceid": "28373f47-5f2f-4c07-8188-7b3edb9cc645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG os_vif [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28373f47-5f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 42484cde-66d6-4816-962b-912f6df59156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 408dc4d1-cbe3-4c99-b709-1956d987209a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032e6ee8-4545-4867-a8ed-4076ed273174 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 486b238c-d628-47c4-9c94-92639359a3ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance fe1c58b4-aece-4ab9-9979-4351104c23d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 91abba0d-17da-4d78-8e2b-b3b741e465d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:42:44 user nova-compute[73450]: INFO os_vif [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:79:d8,bridge_name='br-int',has_traffic_filtering=True,id=28373f47-5f2f-4c07-8188-7b3edb9cc645,network=Network(7095fc2a-f23e-41a0-a951-c44cfa06b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28373f47-5f')
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Deleting instance files /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a_del
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Deletion of /opt/stack/data/nova/instances/408dc4d1-cbe3-4c99-b709-1956d987209a_del complete
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.policy [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3275ae2aaad34aa8adb49e5de0dbe238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f813e9d59945b58a7f0141fb29ca46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.compute.manager [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 16:42:44 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:42:44 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:42:44 user nova-compute[73450]: INFO nova.virt.block_device [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Booting with blank volume at /dev/vda
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Successfully created port: 6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '26230396237356634', 'path': '/dev/sdi'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230396237356634', 'path': '/dev/sdi'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-854210172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1778060136',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGQW4pBqszV7GkT1DSqckRZr1tzOMllClEWD6zRoXgdh3JcdTpIdPRXKM3Rx82f0o7HhR4UciWWoPevsp5DyJaK5ckZnot8UqNXmT795b50ZFx8Z7y7dSRpvnbQLaQ5ow==',key_name='tempest-keypair-400554828',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41319fdc350640e18bd748deb70a3efc',ramdisk_id='',reservation_id='r-4z9dgjse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-592429353',owner_user_name='tempest-ServerActionsV293TestJSON-592429353-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1d1da8ff1204e8490b25aa909744e65',uuid=032e6ee8-4545-4867-a8ed-4076ed273174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converting VIF {"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:42:45 user nova-compute[73450]:   <uuid>032e6ee8-4545-4867-a8ed-4076ed273174</uuid>
Aug 16 16:42:45 user nova-compute[73450]:   <name>instance-00000008</name>
Aug 16 16:42:45 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:42:45 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:42:45 user nova-compute[73450]:   <metadata>
Aug 16 16:42:45 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:42:45 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:42:45 user nova-compute[73450]:       <nova:name>tempest-ServerActionsV293TestJSON-server-854210172</nova:name>
Aug 16 16:42:45 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:42:44</nova:creationTime>
Aug 16 16:42:45 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:42:45 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:42:45 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:42:45 user nova-compute[73450]:       <nova:owner>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:user uuid="e1d1da8ff1204e8490b25aa909744e65">tempest-ServerActionsV293TestJSON-592429353-project-member</nova:user>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:project uuid="41319fdc350640e18bd748deb70a3efc">tempest-ServerActionsV293TestJSON-592429353</nova:project>
Aug 16 16:42:45 user nova-compute[73450]:       </nova:owner>
Aug 16 16:42:45 user nova-compute[73450]:       <nova:ports>
Aug 16 16:42:45 user nova-compute[73450]:         <nova:port uuid="1895c3ed-6e8a-4cab-9eb9-d54458cb589f">
Aug 16 16:42:45 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 16:42:45 user nova-compute[73450]:         </nova:port>
Aug 16 16:42:45 user nova-compute[73450]:       </nova:ports>
Aug 16 16:42:45 user nova-compute[73450]:     </nova:instance>
Aug 16 16:42:45 user nova-compute[73450]:   </metadata>
Aug 16 16:42:45 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:42:45 user nova-compute[73450]:     <system>
Aug 16 16:42:45 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:42:45 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:42:45 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:42:45 user nova-compute[73450]:       <entry name="serial">032e6ee8-4545-4867-a8ed-4076ed273174</entry>
Aug 16 16:42:45 user nova-compute[73450]:       <entry name="uuid">032e6ee8-4545-4867-a8ed-4076ed273174</entry>
Aug 16 16:42:45 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:42:45 user nova-compute[73450]:     </system>
Aug 16 16:42:45 user nova-compute[73450]:   </sysinfo>
Aug 16 16:42:45 user nova-compute[73450]:   <os>
Aug 16 16:42:45 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:42:45 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:42:45 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:42:45 user nova-compute[73450]:   </os>
Aug 16 16:42:45 user nova-compute[73450]:   <features>
Aug 16 16:42:45 user nova-compute[73450]:     <acpi/>
Aug 16 16:42:45 user nova-compute[73450]:     <apic/>
Aug 16 16:42:45 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:42:45 user nova-compute[73450]:   </features>
Aug 16 16:42:45 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:42:45 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:42:45 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:42:45 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:42:45 user nova-compute[73450]:   </clock>
Aug 16 16:42:45 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:42:45 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:42:45 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:42:45 user nova-compute[73450]:   </cpu>
Aug 16 16:42:45 user nova-compute[73450]:   <devices>
Aug 16 16:42:45 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:42:45 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:42:45 user nova-compute[73450]:       <source dev="/dev/sdi"/>
Aug 16 16:42:45 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:42:45 user nova-compute[73450]:       <serial>271210ae-b56b-4e19-a04a-c53c352dd3a9</serial>
Aug 16 16:42:45 user nova-compute[73450]:     </disk>
Aug 16 16:42:45 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:42:45 user nova-compute[73450]:       <mac address="fa:16:3e:c3:27:33"/>
Aug 16 16:42:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:45 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:42:45 user nova-compute[73450]:       <target dev="tap1895c3ed-6e"/>
Aug 16 16:42:45 user nova-compute[73450]:     </interface>
Aug 16 16:42:45 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:42:45 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174/console.log" append="off"/>
Aug 16 16:42:45 user nova-compute[73450]:     </serial>
Aug 16 16:42:45 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:42:45 user nova-compute[73450]:     <video>
Aug 16 16:42:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:42:45 user nova-compute[73450]:     </video>
Aug 16 16:42:45 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:42:45 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:42:45 user nova-compute[73450]:     </rng>
Aug 16 16:42:45 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:42:45 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:42:45 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:42:45 user nova-compute[73450]:     </memballoon>
Aug 16 16:42:45 user nova-compute[73450]:   </devices>
Aug 16 16:42:45 user nova-compute[73450]: </domain>
Aug 16 16:42:45 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-854210172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1778060136',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGQW4pBqszV7GkT1DSqckRZr1tzOMllClEWD6zRoXgdh3JcdTpIdPRXKM3Rx82f0o7HhR4UciWWoPevsp5DyJaK5ckZnot8UqNXmT795b50ZFx8Z7y7dSRpvnbQLaQ5ow==',key_name='tempest-keypair-400554828',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41319fdc350640e18bd748deb70a3efc',ramdisk_id='',reservation_id='r-4z9dgjse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-592429353',owner_user_name='tempest-ServerActionsV293TestJSON-592429353-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1d1da8ff1204e8490b25aa909744e65',uuid=032e6ee8-4545-4867-a8ed-4076ed273174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converting VIF {"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG os_vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1895c3ed-6e, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1895c3ed-6e, col_values=(('external_ids', {'iface-id': '1895c3ed-6e8a-4cab-9eb9-d54458cb589f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:27:33', 'vm-uuid': '032e6ee8-4545-4867-a8ed-4076ed273174'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:45 user nova-compute[73450]: INFO os_vif [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e')
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:42:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] No VIF found with MAC fa:16:3e:c3:27:33, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:46 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Took 1.20 seconds to deallocate network for instance.
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] Acquiring lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] No waiting events found dispatching network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:46 user nova-compute[73450]: WARNING nova.compute.manager [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received unexpected event network-vif-plugged-28373f47-5f2f-4c07-8188-7b3edb9cc645 for instance with vm_state deleted and task_state None.
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-7e29594a-8568-4a84-a634-8acfe21a60ab req-a7d65b41-7323-474a-a740-14a5f62b0e2c service nova] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Received event network-vif-deleted-28373f47-5f2f-4c07-8188-7b3edb9cc645 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Successfully updated port: 6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:42:46 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Deleted allocations for instance 408dc4d1-cbe3-4c99-b709-1956d987209a
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-changed-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Refreshing instance network info cache due to event network-changed-6a7c11f4-7da8-438a-847f-31ccfd4eceea. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] Acquiring lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:42:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-535115c5-af79-4960-8082-13bf05af870b tempest-TaggedAttachmentsTest-443665424 tempest-TaggedAttachmentsTest-443665424-project-member] Lock "408dc4d1-cbe3-4c99-b709-1956d987209a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.031s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating instance_info_cache with network_info: [{"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-42484cde-66d6-4816-962b-912f6df59156" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance network_info: |[{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] Acquired lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Refreshing network info cache for port 6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-9b62284f-422b-480d-9819-ba57068f470d req-3fcefd96-8e28-45e9-b030-fb93f774f64c service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9b62284f-422b-480d-9819-ba57068f470d req-3fcefd96-8e28-45e9-b030-fb93f774f64c service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9b62284f-422b-480d-9819-ba57068f470d req-3fcefd96-8e28-45e9-b030-fb93f774f64c service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9b62284f-422b-480d-9819-ba57068f470d req-3fcefd96-8e28-45e9-b030-fb93f774f64c service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-9b62284f-422b-480d-9819-ba57068f470d req-3fcefd96-8e28-45e9-b030-fb93f774f64c service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:47 user nova-compute[73450]: WARNING nova.compute.manager [req-9b62284f-422b-480d-9819-ba57068f470d req-3fcefd96-8e28-45e9-b030-fb93f774f64c service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state active and task_state rebuild_spawning.
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updated VIF entry in instance network info cache for port 6a7c11f4-7da8-438a-847f-31ccfd4eceea. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:42:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4ba33820-b732-400d-8452-a87e2741e047 req-54173ee0-c059-475f-94cc-2a737107515c service nova] Releasing lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:42:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-9807a9a2-b92c-4b0f-8c27-d881c285f9d8 req-ab76a07c-546e-406f-b56a-44501ff85e73 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9807a9a2-b92c-4b0f-8c27-d881c285f9d8 req-ab76a07c-546e-406f-b56a-44501ff85e73 service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9807a9a2-b92c-4b0f-8c27-d881c285f9d8 req-ab76a07c-546e-406f-b56a-44501ff85e73 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9807a9a2-b92c-4b0f-8c27-d881c285f9d8 req-ab76a07c-546e-406f-b56a-44501ff85e73 service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-9807a9a2-b92c-4b0f-8c27-d881c285f9d8 req-ab76a07c-546e-406f-b56a-44501ff85e73 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:42:49 user nova-compute[73450]: WARNING nova.compute.manager [req-9807a9a2-b92c-4b0f-8c27-d881c285f9d8 req-ab76a07c-546e-406f-b56a-44501ff85e73 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state active and task_state rebuild_spawning.
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204169.754973, 032e6ee8-4545-4867-a8ed-4076ed273174 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] VM Resumed (Lifecycle Event)
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance spawned successfully.
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:42:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204169.7628176, 032e6ee8-4545-4867-a8ed-4076ed273174 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] VM Started (Lifecycle Event)
Aug 16 16:42:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:42:50 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 16:42:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73450) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a138e7e3-4811-4705-af33-022914bbd090 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204155.4954836, 816ac70d-0ed7-4bf0-ae30-f265f7889221 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:50 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] VM Stopped (Lifecycle Event)
Aug 16 16:42:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7805b3e5-eedc-401c-a9d7-edf8a4fcd0db None None] [instance: 816ac70d-0ed7-4bf0-ae30-f265f7889221] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG os_brick.utils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d463495f-35d2-4b2a-8c6c-fdf93818541d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[968a4673-bd1f-4419-9fcf-caf7b7e7b854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe275ecc-e52d-415b-9fee-084b8f9229e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb1ade-46cb-4afa-8355-d42fd616c776]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:42:50 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:42:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5545c3-7d92-46dd-ae1c-379f5910f74b]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG os_brick.utils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating existing volume attachment record: e64cc8eb-bb4b-488b-bfeb-6e5625fe01b4 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:42:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:42:59 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204164.6420317, 408dc4d1-cbe3-4c99-b709-1956d987209a => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:42:59 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] VM Stopped (Lifecycle Event)
Aug 16 16:42:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3c18c9fe-e462-43f3-9b1b-1839ac4cfb5b None None] [instance: 408dc4d1-cbe3-4c99-b709-1956d987209a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:43:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-changed-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing instance network info cache due to event network-changed-9d264822-7290-4f01-b32b-873399b35475. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] Acquiring lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] Acquired lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.network.neutron [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Refreshing network info cache for port 9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-changed-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing instance network info cache due to event network-changed-53fe6daa-d147-4155-b9dd-089e4348294a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] Acquiring lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] Acquired lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.network.neutron [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Refreshing network info cache for port 53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.network.neutron [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updated VIF entry in instance network info cache for port 9d264822-7290-4f01-b32b-873399b35475. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG nova.network.neutron [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [{"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62256516-fc33-453a-a4ae-e6fc6b5cc245 req-5a3df979-23d3-4d51-92f4-efab78130a76 service nova] Releasing lock "refresh_cache-fe1c58b4-aece-4ab9-9979-4351104c23d4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:43:10 user nova-compute[73450]: DEBUG nova.network.neutron [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updated VIF entry in instance network info cache for port 53fe6daa-d147-4155-b9dd-089e4348294a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:43:10 user nova-compute[73450]: DEBUG nova.network.neutron [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-74e83f00-d178-4863-a6bc-ba8be97b0f21 req-ed9d3437-d95b-4b15-9a8f-3f799b2ba2ef service nova] Releasing lock "refresh_cache-486b238c-d628-47c4-9c94-92639359a3ae" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:43:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:11 user nova-compute[73450]: INFO nova.compute.manager [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Terminating instance
Aug 16 16:43:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "486b238c-d628-47c4-9c94-92639359a3ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:12 user nova-compute[73450]: INFO nova.compute.manager [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Terminating instance
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-cd818a41-3632-4760-a40b-d73ba85c0bc6 req-a89d6e8a-16fd-45c5-aeea-7ddc87c1ed3b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cd818a41-3632-4760-a40b-d73ba85c0bc6 req-a89d6e8a-16fd-45c5-aeea-7ddc87c1ed3b service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cd818a41-3632-4760-a40b-d73ba85c0bc6 req-a89d6e8a-16fd-45c5-aeea-7ddc87c1ed3b service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cd818a41-3632-4760-a40b-d73ba85c0bc6 req-a89d6e8a-16fd-45c5-aeea-7ddc87c1ed3b service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-cd818a41-3632-4760-a40b-d73ba85c0bc6 req-a89d6e8a-16fd-45c5-aeea-7ddc87c1ed3b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-cd818a41-3632-4760-a40b-d73ba85c0bc6 req-a89d6e8a-16fd-45c5-aeea-7ddc87c1ed3b service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-108ead71-9f6a-4812-8b78-dd8b5986057f for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-98e6d2eb-d3e4-47ef-928b-cd27c9a9c673 req-e564cd7d-2fa1-4291-99ad-fcae9e32a3fc service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-98e6d2eb-d3e4-47ef-928b-cd27c9a9c673 req-e564cd7d-2fa1-4291-99ad-fcae9e32a3fc service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-98e6d2eb-d3e4-47ef-928b-cd27c9a9c673 req-e564cd7d-2fa1-4291-99ad-fcae9e32a3fc service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-98e6d2eb-d3e4-47ef-928b-cd27c9a9c673 req-e564cd7d-2fa1-4291-99ad-fcae9e32a3fc service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-98e6d2eb-d3e4-47ef-928b-cd27c9a9c673 req-e564cd7d-2fa1-4291-99ad-fcae9e32a3fc service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-98e6d2eb-d3e4-47ef-928b-cd27c9a9c673 req-e564cd7d-2fa1-4291-99ad-fcae9e32a3fc service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-9d264822-7290-4f01-b32b-873399b35475 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-01c93436-73e8-49fa-a68a-33c6aaf4d944 req-e86db6d4-751c-4986-9de5-fc4dcd10b855 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-01c93436-73e8-49fa-a68a-33c6aaf4d944 req-e86db6d4-751c-4986-9de5-fc4dcd10b855 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-01c93436-73e8-49fa-a68a-33c6aaf4d944 req-e86db6d4-751c-4986-9de5-fc4dcd10b855 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-01c93436-73e8-49fa-a68a-33c6aaf4d944 req-e86db6d4-751c-4986-9de5-fc4dcd10b855 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-01c93436-73e8-49fa-a68a-33c6aaf4d944 req-e86db6d4-751c-4986-9de5-fc4dcd10b855 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-01c93436-73e8-49fa-a68a-33c6aaf4d944 req-e86db6d4-751c-4986-9de5-fc4dcd10b855 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Instance destroyed successfully.
Aug 16 16:43:13 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lazy-loading 'resources' on Instance uuid fe1c58b4-aece-4ab9-9979-4351104c23d4 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d264822-72, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:40:88,bridge_name='br-int',has_traffic_filtering=True,id=9d264822-7290-4f01-b32b-873399b35475,network=Network(4ef0c337-8b1e-40a6-a150-70006f1596b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d264822-72')
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap108ead71-9f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:14 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Instance destroyed successfully.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lazy-loading 'resources' on Instance uuid 486b238c-d628-47c4-9c94-92639359a3ae {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-108ead71-9f6a-4812-8b78-dd8b5986057f for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-629248db-6c03-48d6-b25a-522627171671 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-629248db-6c03-48d6-b25a-522627171671 for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-37132e00-2ad0-42c5-95a0-229b165d7d31 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-37132e00-2ad0-42c5-95a0-229b165d7d31 for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-14987bed-cd27-40c1-a174-e7eeaa9e8e5a req-f0fc2e7f-1347-4247-a4b1-368abc202f58 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-9d264822-7290-4f01-b32b-873399b35475 for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-53fe6daa-d147-4155-b9dd-089e4348294a for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-53fe6daa-d147-4155-b9dd-089e4348294a for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f51585f-c384-4d52-9e02-aeb11851477d req-8252ce70-922b-4f90-83df-c0c0d765c2c2 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-57bf521b-d547-4c96-891f-ba608307a692 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53fe6daa-d1, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=108ead71-9f6a-4812-8b78-dd8b5986057f,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap108ead71-9f')
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-0faec9d5-bcd6-45a8-b203-e01e4e470d87 for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-30202e5f-2595-4bfb-b763-18a1e440f71b for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: WARNING nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-30202e5f-2595-4bfb-b763-18a1e440f71b for instance with vm_state active and task_state deleting.
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-1165c0e8-3a3c-47dc-b0c2-93240bda30b6 req-8a03490b-4b7e-4f93-8240-3e21e6e58a5a service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0faec9d5-bc, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:4e:83,bridge_name='br-int',has_traffic_filtering=True,id=53fe6daa-d147-4155-b9dd-089e4348294a,network=Network(c178c9e4-d0e7-43a8-b60d-92e980f2869d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fe6daa-d1')
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:43:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Creating image(s)
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Ensure instance console log exists: /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Start _get_guest_xml network_info=[{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'e64cc8eb-bb4b-488b-bfeb-6e5625fe01b4', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78128529-664d-4e24-9a7b-a242e67a2ddf', 'attached_at': '', 'detached_at': '', 'volume_id': '578ef01e-d82e-4971-b5a5-623d8ccd30aa', 'serial': '578ef01e-d82e-4971-b5a5-623d8ccd30aa'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:43:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:43:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:15 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:15 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e4af2-87bd-49d5-9d21-2ab57802d543]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:43:15 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e882ecc-1d80-474b-8f68-95b5ed0f4492]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa] added
Aug 16 16:43:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f73cf-2377-4041-b3dc-d31db0729a96]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap629248db-6c, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=0faec9d5-bcd6-45a8-b203-e01e4e470d87,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0faec9d5-bc')
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae0dc94-a8e7-4a2a-85d2-bf31ae0d3674]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywLMnsDR {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywLMnsDR" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78255b2-4d71-4e54-8738-b4b27d9bc173]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ywLMnsDR'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0551ebc0-0e53-4fc3-a0c5-1f5183b7d146]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab587d62-d67a-4955-a931-e38d73fd809d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57bf521b-d5, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:59:86,bridge_name='br-int',has_traffic_filtering=True,id=629248db-6c03-48d6-b25a-522627171671,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap629248db-6c')
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e854703b-7ed8-422f-b352-de0e937d4353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260]
Aug 16 16:43:15 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b759244c-08b9-4b1e-a88f-e2ff90e709a7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba43994b-b99d-45ef-a88f-b7877e0f4d60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] HCTL ('41', '-', '-', 0) found on session 20 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37132e00-2a, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:76:6a,bridge_name='br-int',has_traffic_filtering=True,id=57bf521b-d547-4c96-891f-ba608307a692,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bf521b-d5')
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1566ccb-528e-41cf-abbc-87033c2fd17f]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching for a device in session 20 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap454dd224-bb, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:4f,bridge_name='br-int',has_traffic_filtering=True,id=37132e00-2ad0-42c5-95a0-229b165d7d31,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37132e00-2a')
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap168798cb-2e, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:15 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:84:ca,bridge_name='br-int',has_traffic_filtering=True,id=454dd224-bbb2-4eec-a1e0-5a8ec6a2c108,network=Network(67372bdf-3406-47e6-9f8e-37e84deb3dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap454dd224-bb')
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "30202e5f-2595-4bfb-b763-18a1e440f71b", "address": "fa:16:3e:1d:18:e9", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30202e5f-25", "ovs_interfaceid": "30202e5f-2595-4bfb-b763-18a1e440f71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30202e5f-25, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=168798cb-2ee6-4d82-b564-0b62cd5734f2,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168798cb-2e')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "address": "fa:16:3e:26:d2:73", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40fde5-d3", "ovs_interfaceid": "ef40fde5-d32e-49c2-ae82-2766fa3e40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef40fde5-d3, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:18:e9,bridge_name='br-int',has_traffic_filtering=True,id=30202e5f-2595-4bfb-b763-18a1e440f71b,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30202e5f-25')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1444821796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1444821796',id=11,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH2R6Rd2DKcXU9Ru5KUlZ56tS8XC6x6FM1MD0ovPzqdRbDnNUX4Bulbf+Cs/8rEjkFxaKm2LTguTgv4iGrIKyhc+8wTDun9nfPUjG/oHQdPqCitIv57Zm7PbUVTa1i/cg==',key_name='tempest-keypair-2072038779',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27f7949860446f6939fbe2b5bb17e3c',ramdisk_id='',reservation_id='r-d3cdty43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-914937664',owner_user_name='tempest-TaggedBootDevicesTest_v242-914937664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb490f4920d5493a86210353f9c561fa',uuid=fe1c58b4-aece-4ab9-9979-4351104c23d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converting VIF {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe6d7573-6f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0,network=Network(4649260d-b98e-4960-8909-b2385de7db53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40fde5-d3')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0350435a-7a, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3d:b5,bridge_name='br-int',has_traffic_filtering=True,id=be6d7573-6fa6-4a67-a8d3-2db1b0d2e921,network=Network(4ef632e5-4fce-43c0-a7cf-fedecc60d936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6d7573-6f')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsgUDfRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:28:90,bridge_name='br-int',has_traffic_filtering=True,id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0350435a-7a')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-56842240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-56842240',id=10,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP297w1U33weAjg7ljlXS6rEllZaCTWlqEkUxD19jndP2ElEWXOpkJJzeufypvL8ioX6PoBZkpBEik5buoEH1Zom3B1hmw37qiUYcQ8K3l4HRIC/+v5Y+WYrMNBVlq14Rw==',key_name='tempest-keypair-425823350',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb0646d9317488a81d54378cbe49855',ramdisk_id='',reservation_id='r-0w018pok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-821495231',owner_user_name='tempest-TaggedBootDevicesTest-821495231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e35928713fb435bafccc4978bc144a9',uuid=486b238c-d628-47c4-9c94-92639359a3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converting VIF {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3121882-54, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:31,bridge_name='br-int',has_traffic_filtering=True,id=f3121882-5438-4711-bb75-fb4003eb1704,network=Network(b2063884-6f14-4b4a-948e-dbbf7e25beb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3121882-54')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYgnyZLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '23936323430666562', 'path': '/dev/sdj'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936323430666562', 'path': '/dev/sdj'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.547s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-168798cb-2ee6-4d82-b564-0b62cd5734f2 for instance with vm_state active and task_state deleting.
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING nova.compute.manager [req-ac5d1ddf-7852-44ed-997e-0aea02f1776e req-460a265f-034f-4a4b-96a2-4ae81da0cf2b service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 for instance with vm_state active and task_state deleting.
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033664467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033664467',id=16,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-d6yxi6ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:45Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=78128529-664d-4e24-9a7b-a242e67a2ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'pci_devices' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a78d6b-8778-45a6-9471-bbe49f3a9520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:43:16 user nova-compute[73450]:   <uuid>78128529-664d-4e24-9a7b-a242e67a2ddf</uuid>
Aug 16 16:43:16 user nova-compute[73450]:   <name>instance-00000010</name>
Aug 16 16:43:16 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:43:16 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:43:16 user nova-compute[73450]:   <metadata>
Aug 16 16:43:16 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:43:16 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:43:16 user nova-compute[73450]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2033664467</nova:name>
Aug 16 16:43:16 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:43:15</nova:creationTime>
Aug 16 16:43:16 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:43:16 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:43:16 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:43:16 user nova-compute[73450]:       <nova:owner>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:user uuid="3275ae2aaad34aa8adb49e5de0dbe238">tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member</nova:user>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:project uuid="88f813e9d59945b58a7f0141fb29ca46">tempest-ServerBootFromVolumeStableRescueTest-311543227</nova:project>
Aug 16 16:43:16 user nova-compute[73450]:       </nova:owner>
Aug 16 16:43:16 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:43:16 user nova-compute[73450]:       <nova:ports>
Aug 16 16:43:16 user nova-compute[73450]:         <nova:port uuid="6a7c11f4-7da8-438a-847f-31ccfd4eceea">
Aug 16 16:43:16 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 16:43:16 user nova-compute[73450]:         </nova:port>
Aug 16 16:43:16 user nova-compute[73450]:       </nova:ports>
Aug 16 16:43:16 user nova-compute[73450]:     </nova:instance>
Aug 16 16:43:16 user nova-compute[73450]:   </metadata>
Aug 16 16:43:16 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:43:16 user nova-compute[73450]:     <system>
Aug 16 16:43:16 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:43:16 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:43:16 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:43:16 user nova-compute[73450]:       <entry name="serial">78128529-664d-4e24-9a7b-a242e67a2ddf</entry>
Aug 16 16:43:16 user nova-compute[73450]:       <entry name="uuid">78128529-664d-4e24-9a7b-a242e67a2ddf</entry>
Aug 16 16:43:16 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:43:16 user nova-compute[73450]:     </system>
Aug 16 16:43:16 user nova-compute[73450]:   </sysinfo>
Aug 16 16:43:16 user nova-compute[73450]:   <os>
Aug 16 16:43:16 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:43:16 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:43:16 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:43:16 user nova-compute[73450]:   </os>
Aug 16 16:43:16 user nova-compute[73450]:   <features>
Aug 16 16:43:16 user nova-compute[73450]:     <acpi/>
Aug 16 16:43:16 user nova-compute[73450]:     <apic/>
Aug 16 16:43:16 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:43:16 user nova-compute[73450]:   </features>
Aug 16 16:43:16 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:43:16 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:43:16 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:43:16 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:43:16 user nova-compute[73450]:   </clock>
Aug 16 16:43:16 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:43:16 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:43:16 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:43:16 user nova-compute[73450]:   </cpu>
Aug 16 16:43:16 user nova-compute[73450]:   <devices>
Aug 16 16:43:16 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:43:16 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:43:16 user nova-compute[73450]:       <source dev="/dev/sdj"/>
Aug 16 16:43:16 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:43:16 user nova-compute[73450]:       <serial>578ef01e-d82e-4971-b5a5-623d8ccd30aa</serial>
Aug 16 16:43:16 user nova-compute[73450]:     </disk>
Aug 16 16:43:16 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:43:16 user nova-compute[73450]:       <mac address="fa:16:3e:cc:c6:ee"/>
Aug 16 16:43:16 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:43:16 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:43:16 user nova-compute[73450]:       <target dev="tap6a7c11f4-7d"/>
Aug 16 16:43:16 user nova-compute[73450]:     </interface>
Aug 16 16:43:16 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:43:16 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/console.log" append="off"/>
Aug 16 16:43:16 user nova-compute[73450]:     </serial>
Aug 16 16:43:16 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:43:16 user nova-compute[73450]:     <video>
Aug 16 16:43:16 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:43:16 user nova-compute[73450]:     </video>
Aug 16 16:43:16 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:43:16 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:43:16 user nova-compute[73450]:     </rng>
Aug 16 16:43:16 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:43:16 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:43:16 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:43:16 user nova-compute[73450]:     </memballoon>
Aug 16 16:43:16 user nova-compute[73450]:   </devices>
Aug 16 16:43:16 user nova-compute[73450]: </domain>
Aug 16 16:43:16 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033664467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033664467',id=16,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-d6yxi6ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:45Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=78128529-664d-4e24-9a7b-a242e67a2ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_vif [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a7c11f4-7d, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a7c11f4-7d, col_values=(('external_ids', {'iface-id': '6a7c11f4-7da8-438a-847f-31ccfd4eceea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:c6:ee', 'vm-uuid': '78128529-664d-4e24-9a7b-a242e67a2ddf'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e24ab77-3479-4372-b95b-0f70c04e4511]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-57bf521b-d547-4c96-891f-ba608307a692 for instance with vm_state active and task_state deleting.
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-unplugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-unplugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Acquiring lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] No waiting events found dispatching network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received unexpected event network-vif-plugged-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 for instance with vm_state active and task_state deleting.
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-unplugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-unplugged-f3121882-5438-4711-bb75-fb4003eb1704 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING nova.compute.manager [req-a8acf90c-4170-4c8d-a1e2-da995548158e req-3392864c-c8f3-461c-9f17-417a1fe28beb service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-f3121882-5438-4711-bb75-fb4003eb1704 for instance with vm_state active and task_state deleting.
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:16 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2701329e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:43:16 user nova-compute[73450]: INFO os_vif [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d')
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c317adb-41e9-482b-83b7-eb96d53d2a56]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031cf72-bbf2-40b0-9a6c-aff2712b5386]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0725340-bb4f-415d-8c52-d23cba9cc91e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No VIF found with MAC fa:16:3e:cc:c6:ee, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be0b8b0-b3a8-4bff-a665-d7016669b56b]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-bf27d261-9652-440b-97df-202a56641083 req-846d37ae-25dc-4529-9748-79fcf73e63b0 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bf27d261-9652-440b-97df-202a56641083 req-846d37ae-25dc-4529-9748-79fcf73e63b0 service nova] Acquiring lock "486b238c-d628-47c4-9c94-92639359a3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bf27d261-9652-440b-97df-202a56641083 req-846d37ae-25dc-4529-9748-79fcf73e63b0 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bf27d261-9652-440b-97df-202a56641083 req-846d37ae-25dc-4529-9748-79fcf73e63b0 service nova] Lock "486b238c-d628-47c4-9c94-92639359a3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-bf27d261-9652-440b-97df-202a56641083 req-846d37ae-25dc-4529-9748-79fcf73e63b0 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] No waiting events found dispatching network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:16 user nova-compute[73450]: WARNING nova.compute.manager [req-bf27d261-9652-440b-97df-202a56641083 req-846d37ae-25dc-4529-9748-79fcf73e63b0 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received unexpected event network-vif-plugged-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 for instance with vm_state active and task_state deleting.
Aug 16 16:43:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b8fb5-6802-44a0-81d4-c7b80f82e7b5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab284ff1-22ef-4778-9ce8-03a32629c7e8]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260]
Aug 16 16:43:17 user nova-compute[73450]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb40c827-8f1a-445f-8b20-6fb2ed049953 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab9b7a-8519-41b9-8b7d-f5816a591b39]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== disconnect_volume: return (1015ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.987s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DahqsHwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b29341-aacc-4828-a801-17ceadf3b54d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faec6f7-8920-4992-b48a-edb9ef0cac64]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2707b4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dc5b90-8a80-4e5a-a645-456af1b17bbb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[103f922a-0d43-4c46-b8de-e890f7021830]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[32260522-ce9b-4e98-8565-7c8a12d18c2c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b542b2-922b-4f8c-9927-e9d75ee54054]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bdb28d-bedd-4138-b027-e87471e24194]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[221de52e-9484-46a3-b34c-235c39c34eb8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260]
Aug 16 16:43:17 user nova-compute[73450]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdfaeaf4-2c7d-4776-b504-93b245d48881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3de50d-238d-42f2-9fee-6b11da81d764]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== disconnect_volume: return (1439ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.374s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzANeGUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[278309fe-8290-460f-ba6b-f7d575463c41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd08275c-f0e7-48d3-8c7f-42b5f8886e35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:17 user nova-compute[73450]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 (non-flash)
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe27076e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45'): ({'sdg'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Removing single pathed devices sdg {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[43030cea-ff3e-4424-8ed2-54bfd744fad5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde5c817-10ad-4850-a280-44d99e536d97]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Flushing IO for device /dev/sdg {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770f27a-324b-4e21-a348-6d2930899162]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d953890-70ad-4ff2-957b-7f807f2017bc]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] SCSI volumes sdg have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[931cf487-24a2-4d27-899f-fda51b35ab35]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e48f9dd-839a-4fdc-859c-017392ea97be]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260]
Aug 16 16:43:17 user nova-compute[73450]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0a8458-6cc7-4561-8a21-615d26598e45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[53345013-c08e-4767-b48b-1f07ef9bce25]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== disconnect_volume: return (713ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.330s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PygMGkdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0454a0-fccb-409c-bb01-2b13a624d09c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffed3a4-910e-4171-8abb-957e116daaa8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270130550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a1d74-dd42-4ca9-8408-8d0549f7dc20]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[045cf67c-2d6f-4418-a623-4d16d7a9e9ec]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac9a332-b434-44ab-ab99-7ffebe3ac0e8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72cdfe5-8ca2-401c-81da-7fb5d43088e0]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc319b53-4504-4c88-9e47-b74f45c70e54]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa54cb8-10dc-4d3b-9138-93dd81227b23]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260]
Aug 16 16:43:18 user nova-compute[73450]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febc217e-61dc-4557-afaf-c8fa77d4c888 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cb23bb-abd2-4f5c-b810-4170c5202962]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== disconnect_volume: return (675ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.339s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THEOXpYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:43:18 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[594144a9-23a8-4872-8c75-d9ed8d0fb1ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[13474a50-4734-43cd-b67c-d315231c6810]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270130550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122'): ({'sdh'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Removing single pathed devices sdh {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea7318-ad0b-431c-9ad5-deeed73bf268]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde1b1f2-d0fa-42f3-8ae9-10732f4961bb]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Flushing IO for device /dev/sdh {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6982aac-ce43-4727-adef-b1cbd997648d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4686c2-40e4-4882-8a48-255431d375a1]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] SCSI volumes sdh have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee7c86-eecd-430a-9215-2556dbd91339]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b096cb-695d-4b18-9c09-7858e6eb1571]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260]
Aug 16 16:43:18 user nova-compute[73450]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29ac861-4609-440f-be50-a0e91d3dd122 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a8c0b-f78c-47e5-86da-1f2248eda6f8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] <== disconnect_volume: return (683ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:43:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Deleting instance files /opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4_del
Aug 16 16:43:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Deletion of /opt/stack/data/nova/instances/fe1c58b4-aece-4ab9-9979-4351104c23d4_del complete
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.344s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9694c-7f42-499a-8755-542d858a393d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5b1fdd-7e55-430b-b12f-1966c42a82d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:43:18 user nova-compute[73450]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b (non-flash)
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28015e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b'): ({'sdf'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Removing single pathed devices sdf {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: INFO nova.compute.manager [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Took 6.79 seconds to destroy the instance on the hypervisor.
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[26685f7e-a932-46dc-9c5e-266f3a1dc0fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[661b5152-5551-4c94-9df7-8f989d304272]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Flushing IO for device /dev/sdf {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68754fd-57f9-4f26-988b-2b9225bad565]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-50edf1b0-ccd0-449a-bef2-f5e509cd222f req-df15788c-da5b-4c57-986f-751aa4fdc5c9 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-50edf1b0-ccd0-449a-bef2-f5e509cd222f req-df15788c-da5b-4c57-986f-751aa4fdc5c9 service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-50edf1b0-ccd0-449a-bef2-f5e509cd222f req-df15788c-da5b-4c57-986f-751aa4fdc5c9 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-50edf1b0-ccd0-449a-bef2-f5e509cd222f req-df15788c-da5b-4c57-986f-751aa4fdc5c9 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-50edf1b0-ccd0-449a-bef2-f5e509cd222f req-df15788c-da5b-4c57-986f-751aa4fdc5c9 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:18 user nova-compute[73450]: WARNING nova.compute.manager [req-50edf1b0-ccd0-449a-bef2-f5e509cd222f req-df15788c-da5b-4c57-986f-751aa4fdc5c9 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state building and task_state spawning.
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dfc888-d0d3-4ff1-82af-a5bfb9c4d1cb]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d96c0b-6ad3-490a-9e4f-0374df47f234]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[043818bf-339a-4f6d-9238-f90f81911a2a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260]
Aug 16 16:43:18 user nova-compute[73450]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b, portal: 172.16.0.220,3260] successful.
Aug 16 16:43:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39a5388f-5cfb-4462-98e0-12a8edb9515b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b965f87e-9561-424f-b1ae-7185b546fdae]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] <== disconnect_volume: return (674ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:43:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:43:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Deleting instance files /opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae_del
Aug 16 16:43:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Deletion of /opt/stack/data/nova/instances/486b238c-d628-47c4-9c94-92639359a3ae_del complete
Aug 16 16:43:19 user nova-compute[73450]: INFO nova.compute.manager [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Took 6.94 seconds to destroy the instance on the hypervisor.
Aug 16 16:43:19 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:43:19 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:43:19 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204200.6243393, 78128529-664d-4e24-9a7b-a242e67a2ddf => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:43:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Resumed (Lifecycle Event)
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:43:20 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance spawned successfully.
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:43:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204200.6309326, 78128529-664d-4e24-9a7b-a242e67a2ddf => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:43:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Started (Lifecycle Event)
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-ad452018-1ed4-4050-abfb-16775d828a51 req-9bec17ed-3a96-43ae-9636-533df54b7ed6 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ad452018-1ed4-4050-abfb-16775d828a51 req-9bec17ed-3a96-43ae-9636-533df54b7ed6 service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ad452018-1ed4-4050-abfb-16775d828a51 req-9bec17ed-3a96-43ae-9636-533df54b7ed6 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ad452018-1ed4-4050-abfb-16775d828a51 req-9bec17ed-3a96-43ae-9636-533df54b7ed6 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-ad452018-1ed4-4050-abfb-16775d828a51 req-9bec17ed-3a96-43ae-9636-533df54b7ed6 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:43:20 user nova-compute[73450]: WARNING nova.compute.manager [req-ad452018-1ed4-4050-abfb-16775d828a51 req-9bec17ed-3a96-43ae-9636-533df54b7ed6 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state building and task_state spawning.
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:43:20 user nova-compute[73450]: INFO nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 16 16:43:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:43:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:43:21 user nova-compute[73450]: INFO nova.compute.manager [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Took 37.82 seconds to build instance.
Aug 16 16:43:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c3fe32c-ba6c-45db-901b-81d4159e8526 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.041s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-3fb5623f-4ee6-4060-9c85-7c0444d29767 req-35d72373-12a0-4296-b963-c65959d01118 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-deleted-ef40fde5-d32e-49c2-ae82-2766fa3e40d0 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:21 user nova-compute[73450]: INFO nova.compute.manager [req-3fb5623f-4ee6-4060-9c85-7c0444d29767 req-35d72373-12a0-4296-b963-c65959d01118 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Neutron deleted interface ef40fde5-d32e-49c2-ae82-2766fa3e40d0; detaching it from the instance and deleting it from the info cache
Aug 16 16:43:21 user nova-compute[73450]: DEBUG nova.network.neutron [req-3fb5623f-4ee6-4060-9c85-7c0444d29767 req-35d72373-12a0-4296-b963-c65959d01118 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "address": "fa:16:3e:cc:28:90", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0350435a-7a", "ovs_interfaceid": "0350435a-7a63-4ae3-a9b7-0bcfa57646a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-3fb5623f-4ee6-4060-9c85-7c0444d29767 req-35d72373-12a0-4296-b963-c65959d01118 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Detach interface failed, port_id=ef40fde5-d32e-49c2-ae82-2766fa3e40d0, reason: Instance 486b238c-d628-47c4-9c94-92639359a3ae could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:43:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-deleted-30202e5f-2595-4bfb-b763-18a1e440f71b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:22 user nova-compute[73450]: INFO nova.compute.manager [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Neutron deleted interface 30202e5f-2595-4bfb-b763-18a1e440f71b; detaching it from the instance and deleting it from the info cache
Aug 16 16:43:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [{"id": "9d264822-7290-4f01-b32b-873399b35475", "address": "fa:16:3e:10:40:88", "network": {"id": "4ef0c337-8b1e-40a6-a150-70006f1596b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1036451341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d264822-72", "ovs_interfaceid": "9d264822-7290-4f01-b32b-873399b35475", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Detach interface failed, port_id=30202e5f-2595-4bfb-b763-18a1e440f71b, reason: Instance fe1c58b4-aece-4ab9-9979-4351104c23d4 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-deleted-9d264822-7290-4f01-b32b-873399b35475 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:23 user nova-compute[73450]: INFO nova.compute.manager [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Neutron deleted interface 9d264822-7290-4f01-b32b-873399b35475; detaching it from the instance and deleting it from the info cache
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [{"id": "108ead71-9f6a-4812-8b78-dd8b5986057f", "address": "fa:16:3e:34:18:a2", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ead71-9f", "ovs_interfaceid": "108ead71-9f6a-4812-8b78-dd8b5986057f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "address": "fa:16:3e:3e:dc:32", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faec9d5-bc", "ovs_interfaceid": "0faec9d5-bcd6-45a8-b203-e01e4e470d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bf521b-d547-4c96-891f-ba608307a692", "address": "fa:16:3e:79:76:6a", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bf521b-d5", "ovs_interfaceid": "57bf521b-d547-4c96-891f-ba608307a692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "address": "fa:16:3e:10:84:ca", "network": {"id": "67372bdf-3406-47e6-9f8e-37e84deb3dbc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1959070690", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap454dd224-bb", "ovs_interfaceid": "454dd224-bbb2-4eec-a1e0-5a8ec6a2c108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "address": "fa:16:3e:4d:3d:b5", "network": {"id": "4ef632e5-4fce-43c0-a7cf-fedecc60d936", "bridge": "br-int", "label": "tempest-device-tagging-net2-449812006", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b27f7949860446f6939fbe2b5bb17e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6d7573-6f", "ovs_interfaceid": "be6d7573-6fa6-4a67-a8d3-2db1b0d2e921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-40a3d918-df71-4bb4-bc05-25c0d91fc2d9 req-b3a0d6ab-8d23-404b-9d90-a0a6cd79ced7 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Detach interface failed, port_id=9d264822-7290-4f01-b32b-873399b35475, reason: Instance fe1c58b4-aece-4ab9-9979-4351104c23d4 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-deleted-0350435a-7a63-4ae3-a9b7-0bcfa57646a2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:23 user nova-compute[73450]: INFO nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Neutron deleted interface 0350435a-7a63-4ae3-a9b7-0bcfa57646a2; detaching it from the instance and deleting it from the info cache
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "address": "fa:16:3e:76:cf:a3", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168798cb-2e", "ovs_interfaceid": "168798cb-2ee6-4d82-b564-0b62cd5734f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Detach interface failed, port_id=0350435a-7a63-4ae3-a9b7-0bcfa57646a2, reason: Instance 486b238c-d628-47c4-9c94-92639359a3ae could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-deleted-168798cb-2ee6-4d82-b564-0b62cd5734f2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:23 user nova-compute[73450]: INFO nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Neutron deleted interface 168798cb-2ee6-4d82-b564-0b62cd5734f2; detaching it from the instance and deleting it from the info cache
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3121882-5438-4711-bb75-fb4003eb1704", "address": "fa:16:3e:b7:c0:31", "network": {"id": "b2063884-6f14-4b4a-948e-dbbf7e25beb0", "bridge": "br-int", "label": "tempest-device-tagging-net2-353364522", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3121882-54", "ovs_interfaceid": "f3121882-5438-4711-bb75-fb4003eb1704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Detach interface failed, port_id=168798cb-2ee6-4d82-b564-0b62cd5734f2, reason: Instance 486b238c-d628-47c4-9c94-92639359a3ae could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-deleted-f3121882-5438-4711-bb75-fb4003eb1704 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:23 user nova-compute[73450]: INFO nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Neutron deleted interface f3121882-5438-4711-bb75-fb4003eb1704; detaching it from the instance and deleting it from the info cache
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [{"id": "53fe6daa-d147-4155-b9dd-089e4348294a", "address": "fa:16:3e:f7:4e:83", "network": {"id": "c178c9e4-d0e7-43a8-b60d-92e980f2869d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232072907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fe6daa-d1", "ovs_interfaceid": "53fe6daa-d147-4155-b9dd-089e4348294a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "629248db-6c03-48d6-b25a-522627171671", "address": "fa:16:3e:c7:59:86", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap629248db-6c", "ovs_interfaceid": "629248db-6c03-48d6-b25a-522627171671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37132e00-2ad0-42c5-95a0-229b165d7d31", "address": "fa:16:3e:d0:61:4f", "network": {"id": "4649260d-b98e-4960-8909-b2385de7db53", "bridge": "br-int", "label": "tempest-device-tagging-net1-280881815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eb0646d9317488a81d54378cbe49855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37132e00-2a", "ovs_interfaceid": "37132e00-2ad0-42c5-95a0-229b165d7d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0a7eb07-c7af-4a28-93f2-5a9b097fa2ad req-b0844d58-3341-4367-ab7d-0211723ec4ab service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Detach interface failed, port_id=f3121882-5438-4711-bb75-fb4003eb1704, reason: Instance 486b238c-d628-47c4-9c94-92639359a3ae could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:43:23 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:23 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Took 4.75 seconds to deallocate network for instance.
Aug 16 16:43:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:24 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:24 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Took 5.32 seconds to deallocate network for instance.
Aug 16 16:43:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-314112be-231c-4521-af61-0d77ebaf4de0 req-d96dd285-8461-44c6-874a-08309e8e23b9 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-deleted-454dd224-bbb2-4eec-a1e0-5a8ec6a2c108 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-314112be-231c-4521-af61-0d77ebaf4de0 req-d96dd285-8461-44c6-874a-08309e8e23b9 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-deleted-be6d7573-6fa6-4a67-a8d3-2db1b0d2e921 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-314112be-231c-4521-af61-0d77ebaf4de0 req-d96dd285-8461-44c6-874a-08309e8e23b9 service nova] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Received event network-vif-deleted-57bf521b-d547-4c96-891f-ba608307a692 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-d08926c3-cc7d-4d5d-b02a-5a30500de9f2 req-a0860601-9ae6-431f-ae2f-6b273a8b1126 service nova] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Received event network-vif-deleted-53fe6daa-d147-4155-b9dd-089e4348294a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:27 user nova-compute[73450]: INFO nova.compute.manager [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Took 3.10 seconds to detach 3 volumes for instance.
Aug 16 16:43:27 user nova-compute[73450]: INFO nova.compute.manager [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Took 3.36 seconds to detach 3 volumes for instance.
Aug 16 16:43:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.366s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:27 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Deleted allocations for instance fe1c58b4-aece-4ab9-9979-4351104c23d4
Aug 16 16:43:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a1bf94b4-b368-43e2-abfd-4257ea284210 tempest-TaggedBootDevicesTest_v242-914937664 tempest-TaggedBootDevicesTest_v242-914937664-project-member] Lock "fe1c58b4-aece-4ab9-9979-4351104c23d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.795s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:27 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:43:28 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:43:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:28 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Deleted allocations for instance 486b238c-d628-47c4-9c94-92639359a3ae
Aug 16 16:43:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be8ffadd-a1a2-4551-8114-440bde76a359 tempest-TaggedBootDevicesTest-821495231 tempest-TaggedBootDevicesTest-821495231-project-member] Lock "486b238c-d628-47c4-9c94-92639359a3ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.083s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:28 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204193.7844436, fe1c58b4-aece-4ab9-9979-4351104c23d4 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:43:28 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] VM Stopped (Lifecycle Event)
Aug 16 16:43:28 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ab80def1-c800-4ee2-bd52-cfc4357d5220 None None] [instance: fe1c58b4-aece-4ab9-9979-4351104c23d4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:43:29 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204194.4157257, 486b238c-d628-47c4-9c94-92639359a3ae => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:43:29 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] VM Stopped (Lifecycle Event)
Aug 16 16:43:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-83f2a152-d46a-4cbc-82a3-20fd33e8dd69 None None] [instance: 486b238c-d628-47c4-9c94-92639359a3ae] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:43:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating instance_info_cache with network_info: [{"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-6f285797-8d8a-4b6f-9f39-c79b71124f69" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:43:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:43:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:43:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=24.382835388183594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 42484cde-66d6-4816-962b-912f6df59156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032e6ee8-4545-4867-a8ed-4076ed273174 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 91abba0d-17da-4d78-8e2b-b3b741e465d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:43:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:43:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:43:57 user nova-compute[73450]: INFO nova.compute.claims [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Claim successful on node user
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:43:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:43:58 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.policy [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '046d6f165b1d433d811270235272d9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a752b1016e433f8615898e0dbcfe55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:43:58 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Creating image(s)
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "/opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "/opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "/opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "4ebb9fc5c213e9361103bbab9e742148a7d65247" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "4ebb9fc5c213e9361103bbab9e742148a7d65247" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.part --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.virt.images [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] 8bc92e85-3a6a-4d45-8fa5-255660713803 was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.part /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:58 user nova-compute[73450]: DEBUG nova.network.neutron [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Successfully created port: 66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.part /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.converted" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "4ebb9fc5c213e9361103bbab9e742148a7d65247" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.980s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "4ebb9fc5c213e9361103bbab9e742148a7d65247" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "4ebb9fc5c213e9361103bbab9e742148a7d65247" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 --force-share --output=json" returned: 0 in 0.166s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247,backing_fmt=raw /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247,backing_fmt=raw /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk 1073741824" returned: 0 in 0.046s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "4ebb9fc5c213e9361103bbab9e742148a7d65247" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Successfully updated port: 66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-changed-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Refreshing instance network info cache due to event network-changed-66e95def-8bb9-4a6c-9dfe-b286396ac0b6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] Acquiring lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] Acquired lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Refreshing network info cache for port 66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:43:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Cannot resize image /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lazy-loading 'migration_context' on Instance uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Ensure instance console log exists: /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-99c76319-35d3-4082-bf3c-07253cef0b47 req-bd40fdcc-ec18-430e-ad81-da2a72407118 service nova] Releasing lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquired lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.neutron [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.neutron [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.neutron [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updating instance_info_cache with network_info: [{"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Releasing lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Instance network_info: |[{"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Start _get_guest_xml network_info=[{"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:43:51Z,direct_url=<?>,disk_format='qcow2',id=8bc92e85-3a6a-4d45-8fa5-255660713803,min_disk=0,min_ram=0,name='',owner='bb81b06c54a94820a605e9b91d7a86fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:43:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/sda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': '8bc92e85-3a6a-4d45-8fa5-255660713803'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:44:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:43:51Z,direct_url=<?>,disk_format='qcow2',id=8bc92e85-3a6a-4d45-8fa5-255660713803,min_disk=0,min_ram=0,name='',owner='bb81b06c54a94820a605e9b91d7a86fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:43:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1626750148',display_name='tempest-AttachSCSIVolumeTestJSON-server-1626750148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1626750148',id=17,image_ref='8bc92e85-3a6a-4d45-8fa5-255660713803',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWKA9EIiific0Lia5boRlyyz9WatmQknC4Qzr+5pTX9XaT5R+RYYa4wNHcvI9z+kxqmUwpEVjA0WbnBPUc/GakzXii6n6xNlR0fxbDfNkedV/HfkbgnIOKxjrM2wBC+LQ==',key_name='tempest-keypair-851990394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98a752b1016e433f8615898e0dbcfe55',ramdisk_id='',reservation_id='r-3tw5ifeg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8bc92e85-3a6a-4d45-8fa5-255660713803',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1791956531',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1791956531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='046d6f165b1d433d811270235272d9c3',uuid=ada60a07-c8f4-4dd6-a68e-a46121493bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Converting VIF {"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lazy-loading 'pci_devices' on Instance uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:44:00 user nova-compute[73450]:   <uuid>ada60a07-c8f4-4dd6-a68e-a46121493bce</uuid>
Aug 16 16:44:00 user nova-compute[73450]:   <name>instance-00000011</name>
Aug 16 16:44:00 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:44:00 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:44:00 user nova-compute[73450]:   <metadata>
Aug 16 16:44:00 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:44:00 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:44:00 user nova-compute[73450]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1626750148</nova:name>
Aug 16 16:44:00 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:44:00</nova:creationTime>
Aug 16 16:44:00 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:44:00 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:44:00 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:44:00 user nova-compute[73450]:       <nova:owner>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:user uuid="046d6f165b1d433d811270235272d9c3">tempest-AttachSCSIVolumeTestJSON-1791956531-project-member</nova:user>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:project uuid="98a752b1016e433f8615898e0dbcfe55">tempest-AttachSCSIVolumeTestJSON-1791956531</nova:project>
Aug 16 16:44:00 user nova-compute[73450]:       </nova:owner>
Aug 16 16:44:00 user nova-compute[73450]:       <nova:root type="image" uuid="8bc92e85-3a6a-4d45-8fa5-255660713803"/>
Aug 16 16:44:00 user nova-compute[73450]:       <nova:ports>
Aug 16 16:44:00 user nova-compute[73450]:         <nova:port uuid="66e95def-8bb9-4a6c-9dfe-b286396ac0b6">
Aug 16 16:44:00 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 16:44:00 user nova-compute[73450]:         </nova:port>
Aug 16 16:44:00 user nova-compute[73450]:       </nova:ports>
Aug 16 16:44:00 user nova-compute[73450]:     </nova:instance>
Aug 16 16:44:00 user nova-compute[73450]:   </metadata>
Aug 16 16:44:00 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:44:00 user nova-compute[73450]:     <system>
Aug 16 16:44:00 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:44:00 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:44:00 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:44:00 user nova-compute[73450]:       <entry name="serial">ada60a07-c8f4-4dd6-a68e-a46121493bce</entry>
Aug 16 16:44:00 user nova-compute[73450]:       <entry name="uuid">ada60a07-c8f4-4dd6-a68e-a46121493bce</entry>
Aug 16 16:44:00 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:44:00 user nova-compute[73450]:     </system>
Aug 16 16:44:00 user nova-compute[73450]:   </sysinfo>
Aug 16 16:44:00 user nova-compute[73450]:   <os>
Aug 16 16:44:00 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:44:00 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:44:00 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:44:00 user nova-compute[73450]:   </os>
Aug 16 16:44:00 user nova-compute[73450]:   <features>
Aug 16 16:44:00 user nova-compute[73450]:     <acpi/>
Aug 16 16:44:00 user nova-compute[73450]:     <apic/>
Aug 16 16:44:00 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:44:00 user nova-compute[73450]:   </features>
Aug 16 16:44:00 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:44:00 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:44:00 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:44:00 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:44:00 user nova-compute[73450]:   </clock>
Aug 16 16:44:00 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:44:00 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:44:00 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:44:00 user nova-compute[73450]:   </cpu>
Aug 16 16:44:00 user nova-compute[73450]:   <devices>
Aug 16 16:44:00 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:44:00 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:44:00 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk"/>
Aug 16 16:44:00 user nova-compute[73450]:       <target dev="sda" bus="scsi"/>
Aug 16 16:44:00 user nova-compute[73450]:       <address type="drive" controller="0" unit="0"/>
Aug 16 16:44:00 user nova-compute[73450]:     </disk>
Aug 16 16:44:00 user nova-compute[73450]:     <disk type="file" device="cdrom">
Aug 16 16:44:00 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 16:44:00 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.config"/>
Aug 16 16:44:00 user nova-compute[73450]:       <target dev="sdb" bus="scsi"/>
Aug 16 16:44:00 user nova-compute[73450]:       <address type="drive" controller="0" unit="1"/>
Aug 16 16:44:00 user nova-compute[73450]:     </disk>
Aug 16 16:44:00 user nova-compute[73450]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 16:44:00 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:44:00 user nova-compute[73450]:       <mac address="fa:16:3e:77:22:82"/>
Aug 16 16:44:00 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:00 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:44:00 user nova-compute[73450]:       <target dev="tap66e95def-8b"/>
Aug 16 16:44:00 user nova-compute[73450]:     </interface>
Aug 16 16:44:00 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:44:00 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/console.log" append="off"/>
Aug 16 16:44:00 user nova-compute[73450]:     </serial>
Aug 16 16:44:00 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:44:00 user nova-compute[73450]:     <video>
Aug 16 16:44:00 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:00 user nova-compute[73450]:     </video>
Aug 16 16:44:00 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:44:00 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:44:00 user nova-compute[73450]:     </rng>
Aug 16 16:44:00 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:44:00 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:44:00 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:44:00 user nova-compute[73450]:     </memballoon>
Aug 16 16:44:00 user nova-compute[73450]:   </devices>
Aug 16 16:44:00 user nova-compute[73450]: </domain>
Aug 16 16:44:00 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1626750148',display_name='tempest-AttachSCSIVolumeTestJSON-server-1626750148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1626750148',id=17,image_ref='8bc92e85-3a6a-4d45-8fa5-255660713803',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWKA9EIiific0Lia5boRlyyz9WatmQknC4Qzr+5pTX9XaT5R+RYYa4wNHcvI9z+kxqmUwpEVjA0WbnBPUc/GakzXii6n6xNlR0fxbDfNkedV/HfkbgnIOKxjrM2wBC+LQ==',key_name='tempest-keypair-851990394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98a752b1016e433f8615898e0dbcfe55',ramdisk_id='',reservation_id='r-3tw5ifeg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8bc92e85-3a6a-4d45-8fa5-255660713803',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1791956531',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1791956531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='046d6f165b1d433d811270235272d9c3',uuid=ada60a07-c8f4-4dd6-a68e-a46121493bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Converting VIF {"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG os_vif [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66e95def-8b, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66e95def-8b, col_values=(('external_ids', {'iface-id': '66e95def-8bb9-4a6c-9dfe-b286396ac0b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:22:82', 'vm-uuid': 'ada60a07-c8f4-4dd6-a68e-a46121493bce'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:00 user nova-compute[73450]: INFO os_vif [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b')
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No BDM found with device name sda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No VIF found with MAC fa:16:3e:77:22:82, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:44:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Using config drive
Aug 16 16:44:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Creating config drive at /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.config
Aug 16 16:44:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz0dp_1og {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz0dp_1og" returned: 0 in 0.054s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [req-59d2a6f6-9d69-4e10-8755-f8105a6382b3 req-0c53f113-4ed9-4f9b-8720-40dc38fabd01 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-59d2a6f6-9d69-4e10-8755-f8105a6382b3 req-0c53f113-4ed9-4f9b-8720-40dc38fabd01 service nova] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-59d2a6f6-9d69-4e10-8755-f8105a6382b3 req-0c53f113-4ed9-4f9b-8720-40dc38fabd01 service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-59d2a6f6-9d69-4e10-8755-f8105a6382b3 req-0c53f113-4ed9-4f9b-8720-40dc38fabd01 service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [req-59d2a6f6-9d69-4e10-8755-f8105a6382b3 req-0c53f113-4ed9-4f9b-8720-40dc38fabd01 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] No waiting events found dispatching network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:04 user nova-compute[73450]: WARNING nova.compute.manager [req-59d2a6f6-9d69-4e10-8755-f8105a6382b3 req-0c53f113-4ed9-4f9b-8720-40dc38fabd01 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received unexpected event network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 for instance with vm_state building and task_state spawning.
Aug 16 16:44:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204244.661446, ada60a07-c8f4-4dd6-a68e-a46121493bce => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] VM Resumed (Lifecycle Event)
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Instance spawned successfully.
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204244.6631398, ada60a07-c8f4-4dd6-a68e-a46121493bce => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] VM Started (Lifecycle Event)
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:44:04 user nova-compute[73450]: INFO nova.compute.manager [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Took 7.43 seconds to build instance.
Aug 16 16:44:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-548cfdd1-5979-4bf8-8735-2b24190a7ebc tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.531s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c0cb0cd-5591-4f78-9b47-044043a3955c req-0673e2eb-e835-43c4-866a-a3d7e1055858 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c0cb0cd-5591-4f78-9b47-044043a3955c req-0673e2eb-e835-43c4-866a-a3d7e1055858 service nova] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c0cb0cd-5591-4f78-9b47-044043a3955c req-0673e2eb-e835-43c4-866a-a3d7e1055858 service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c0cb0cd-5591-4f78-9b47-044043a3955c req-0673e2eb-e835-43c4-866a-a3d7e1055858 service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c0cb0cd-5591-4f78-9b47-044043a3955c req-0673e2eb-e835-43c4-866a-a3d7e1055858 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] No waiting events found dispatching network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:06 user nova-compute[73450]: WARNING nova.compute.manager [req-5c0cb0cd-5591-4f78-9b47-044043a3955c req-0673e2eb-e835-43c4-866a-a3d7e1055858 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received unexpected event network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 for instance with vm_state active and task_state None.
Aug 16 16:44:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:44:09 user nova-compute[73450]: INFO nova.compute.claims [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Claim successful on node user
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.network.neutron [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:44:09 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.policy [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb44f7411ad47b18d2c58a1dc6ac074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db72f2fe40fe410098164a19683782d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:44:09 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Creating image(s)
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "/opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "/opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "/opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk 1073741824" returned: 0 in 0.060s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG nova.network.neutron [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Successfully created port: 77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Cannot resize image /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG nova.objects.instance [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'migration_context' on Instance uuid eed98e2e-e225-483c-93bf-b8100e2bc5fe {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Ensure instance console log exists: /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Successfully updated port: 77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-changed-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Refreshing instance network info cache due to event network-changed-77f40a61-d7ad-4a05-81bc-c24b58ba65f6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Instance network_info: |[{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.network.neutron [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Refreshing network info cache for port 77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Start _get_guest_xml network_info=[{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:44:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:44:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-856970353',display_name='tempest-ServerActionsTestOtherA-server-856970353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-856970353',id=18,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-q059elxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=eed98e2e-e225-483c-93bf-b8100e2bc5fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_devices' on Instance uuid eed98e2e-e225-483c-93bf-b8100e2bc5fe {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:44:12 user nova-compute[73450]:   <uuid>eed98e2e-e225-483c-93bf-b8100e2bc5fe</uuid>
Aug 16 16:44:12 user nova-compute[73450]:   <name>instance-00000012</name>
Aug 16 16:44:12 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:44:12 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:44:12 user nova-compute[73450]:   <metadata>
Aug 16 16:44:12 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:44:12 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:44:12 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherA-server-856970353</nova:name>
Aug 16 16:44:12 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:44:11</nova:creationTime>
Aug 16 16:44:12 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:44:12 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:44:12 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:44:12 user nova-compute[73450]:       <nova:owner>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:user uuid="cfb44f7411ad47b18d2c58a1dc6ac074">tempest-ServerActionsTestOtherA-1309270761-project-member</nova:user>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:project uuid="db72f2fe40fe410098164a19683782d4">tempest-ServerActionsTestOtherA-1309270761</nova:project>
Aug 16 16:44:12 user nova-compute[73450]:       </nova:owner>
Aug 16 16:44:12 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:44:12 user nova-compute[73450]:       <nova:ports>
Aug 16 16:44:12 user nova-compute[73450]:         <nova:port uuid="77f40a61-d7ad-4a05-81bc-c24b58ba65f6">
Aug 16 16:44:12 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:44:12 user nova-compute[73450]:         </nova:port>
Aug 16 16:44:12 user nova-compute[73450]:       </nova:ports>
Aug 16 16:44:12 user nova-compute[73450]:     </nova:instance>
Aug 16 16:44:12 user nova-compute[73450]:   </metadata>
Aug 16 16:44:12 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:44:12 user nova-compute[73450]:     <system>
Aug 16 16:44:12 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:44:12 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:44:12 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:44:12 user nova-compute[73450]:       <entry name="serial">eed98e2e-e225-483c-93bf-b8100e2bc5fe</entry>
Aug 16 16:44:12 user nova-compute[73450]:       <entry name="uuid">eed98e2e-e225-483c-93bf-b8100e2bc5fe</entry>
Aug 16 16:44:12 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:44:12 user nova-compute[73450]:     </system>
Aug 16 16:44:12 user nova-compute[73450]:   </sysinfo>
Aug 16 16:44:12 user nova-compute[73450]:   <os>
Aug 16 16:44:12 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:44:12 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:44:12 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:44:12 user nova-compute[73450]:   </os>
Aug 16 16:44:12 user nova-compute[73450]:   <features>
Aug 16 16:44:12 user nova-compute[73450]:     <acpi/>
Aug 16 16:44:12 user nova-compute[73450]:     <apic/>
Aug 16 16:44:12 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:44:12 user nova-compute[73450]:   </features>
Aug 16 16:44:12 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:44:12 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:44:12 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:44:12 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:44:12 user nova-compute[73450]:   </clock>
Aug 16 16:44:12 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:44:12 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:44:12 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:44:12 user nova-compute[73450]:   </cpu>
Aug 16 16:44:12 user nova-compute[73450]:   <devices>
Aug 16 16:44:12 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:44:12 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:44:12 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk"/>
Aug 16 16:44:12 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:44:12 user nova-compute[73450]:     </disk>
Aug 16 16:44:12 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:44:12 user nova-compute[73450]:       <mac address="fa:16:3e:06:2f:dc"/>
Aug 16 16:44:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:12 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:44:12 user nova-compute[73450]:       <target dev="tap77f40a61-d7"/>
Aug 16 16:44:12 user nova-compute[73450]:     </interface>
Aug 16 16:44:12 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:44:12 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/console.log" append="off"/>
Aug 16 16:44:12 user nova-compute[73450]:     </serial>
Aug 16 16:44:12 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:44:12 user nova-compute[73450]:     <video>
Aug 16 16:44:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:12 user nova-compute[73450]:     </video>
Aug 16 16:44:12 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:44:12 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:44:12 user nova-compute[73450]:     </rng>
Aug 16 16:44:12 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:44:12 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:44:12 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:44:12 user nova-compute[73450]:     </memballoon>
Aug 16 16:44:12 user nova-compute[73450]:   </devices>
Aug 16 16:44:12 user nova-compute[73450]: </domain>
Aug 16 16:44:12 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-856970353',display_name='tempest-ServerActionsTestOtherA-server-856970353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-856970353',id=18,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-q059elxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=eed98e2e-e225-483c-93bf-b8100e2bc5fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG os_vif [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f40a61-d7, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77f40a61-d7, col_values=(('external_ids', {'iface-id': '77f40a61-d7ad-4a05-81bc-c24b58ba65f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:2f:dc', 'vm-uuid': 'eed98e2e-e225-483c-93bf-b8100e2bc5fe'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:12 user nova-compute[73450]: INFO os_vif [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7')
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No VIF found with MAC fa:16:3e:06:2f:dc, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.network.neutron [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updated VIF entry in instance network info cache for port 77f40a61-d7ad-4a05-81bc-c24b58ba65f6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG nova.network.neutron [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4c218ea1-551c-4fa1-bf3a-c646ebba41f4 req-701e74b7-3f76-4827-8c88-5e864731cb4a service nova] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-735be506-c1e4-450e-86d7-a14dd4f4ccec req-1b72fb59-d8fb-40e3-a7be-e4e8de261431 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-735be506-c1e4-450e-86d7-a14dd4f4ccec req-1b72fb59-d8fb-40e3-a7be-e4e8de261431 service nova] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-735be506-c1e4-450e-86d7-a14dd4f4ccec req-1b72fb59-d8fb-40e3-a7be-e4e8de261431 service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-735be506-c1e4-450e-86d7-a14dd4f4ccec req-1b72fb59-d8fb-40e3-a7be-e4e8de261431 service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-735be506-c1e4-450e-86d7-a14dd4f4ccec req-1b72fb59-d8fb-40e3-a7be-e4e8de261431 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] No waiting events found dispatching network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:14 user nova-compute[73450]: WARNING nova.compute.manager [req-735be506-c1e4-450e-86d7-a14dd4f4ccec req-1b72fb59-d8fb-40e3-a7be-e4e8de261431 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received unexpected event network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 for instance with vm_state building and task_state spawning.
Aug 16 16:44:14 user nova-compute[73450]: INFO nova.compute.manager [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Rescuing
Aug 16 16:44:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG nova.network.neutron [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] No waiting events found dispatching network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:16 user nova-compute[73450]: WARNING nova.compute.manager [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received unexpected event network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 for instance with vm_state building and task_state spawning.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-unplugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-unplugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:16 user nova-compute[73450]: WARNING nova.compute.manager [req-d23c1f10-2cf5-4d52-87a1-e88335b5bf9b req-c35c6532-d3d0-48ed-ba80-1c4e6efaf56c service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-unplugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state active and task_state rescuing.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204256.4052074, eed98e2e-e225-483c-93bf-b8100e2bc5fe => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] VM Resumed (Lifecycle Event)
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Instance spawned successfully.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204256.40617, eed98e2e-e225-483c-93bf-b8100e2bc5fe => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] VM Started (Lifecycle Event)
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance destroyed successfully.
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Attempting rescue
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73450) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Creating image(s)
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Took 6.73 seconds to spawn the instance on the hypervisor.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:44:16 user nova-compute[73450]: INFO nova.compute.manager [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Took 7.70 seconds to build instance.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e6f5ec11-e5a5-493c-bb74-5cce14d44911 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.276s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue" returned: 0 in 0.061s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'migration_context' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Start _get_guest_xml network_info=[{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:e0:87:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'resources' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'numa_topology' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:44:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-237743492',display_name='tempest-ServerRescueNegativeTestJSON-server-237743492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-237743492',id=14,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-5z2ybtij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:34Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=d1731c4d-0c63-4394-b50e-2db9c23a6951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:e0:87:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:e0:87:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'pci_devices' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:44:17 user nova-compute[73450]:   <uuid>d1731c4d-0c63-4394-b50e-2db9c23a6951</uuid>
Aug 16 16:44:17 user nova-compute[73450]:   <name>instance-0000000e</name>
Aug 16 16:44:17 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:44:17 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:44:17 user nova-compute[73450]:   <metadata>
Aug 16 16:44:17 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:44:17 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:44:17 user nova-compute[73450]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-237743492</nova:name>
Aug 16 16:44:17 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:44:16</nova:creationTime>
Aug 16 16:44:17 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:44:17 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:44:17 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:44:17 user nova-compute[73450]:       <nova:owner>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:user uuid="19d604d793314808984e92afdc5f5da0">tempest-ServerRescueNegativeTestJSON-976614040-project-member</nova:user>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:project uuid="ad178c8525774ad2a342015b9dc1fbf2">tempest-ServerRescueNegativeTestJSON-976614040</nova:project>
Aug 16 16:44:17 user nova-compute[73450]:       </nova:owner>
Aug 16 16:44:17 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:44:17 user nova-compute[73450]:       <nova:ports>
Aug 16 16:44:17 user nova-compute[73450]:         <nova:port uuid="40122be5-d72a-4bef-8bbd-4899062d67fa">
Aug 16 16:44:17 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:44:17 user nova-compute[73450]:         </nova:port>
Aug 16 16:44:17 user nova-compute[73450]:       </nova:ports>
Aug 16 16:44:17 user nova-compute[73450]:     </nova:instance>
Aug 16 16:44:17 user nova-compute[73450]:   </metadata>
Aug 16 16:44:17 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:44:17 user nova-compute[73450]:     <system>
Aug 16 16:44:17 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:44:17 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:44:17 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:44:17 user nova-compute[73450]:       <entry name="serial">d1731c4d-0c63-4394-b50e-2db9c23a6951</entry>
Aug 16 16:44:17 user nova-compute[73450]:       <entry name="uuid">d1731c4d-0c63-4394-b50e-2db9c23a6951</entry>
Aug 16 16:44:17 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:44:17 user nova-compute[73450]:     </system>
Aug 16 16:44:17 user nova-compute[73450]:   </sysinfo>
Aug 16 16:44:17 user nova-compute[73450]:   <os>
Aug 16 16:44:17 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:44:17 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:44:17 user nova-compute[73450]:   </os>
Aug 16 16:44:17 user nova-compute[73450]:   <features>
Aug 16 16:44:17 user nova-compute[73450]:     <acpi/>
Aug 16 16:44:17 user nova-compute[73450]:     <apic/>
Aug 16 16:44:17 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:44:17 user nova-compute[73450]:   </features>
Aug 16 16:44:17 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:44:17 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:44:17 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:44:17 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:44:17 user nova-compute[73450]:   </clock>
Aug 16 16:44:17 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:44:17 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:44:17 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:44:17 user nova-compute[73450]:   </cpu>
Aug 16 16:44:17 user nova-compute[73450]:   <devices>
Aug 16 16:44:17 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:44:17 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:44:17 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue"/>
Aug 16 16:44:17 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:44:17 user nova-compute[73450]:     </disk>
Aug 16 16:44:17 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:44:17 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:44:17 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk"/>
Aug 16 16:44:17 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:44:17 user nova-compute[73450]:     </disk>
Aug 16 16:44:17 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:44:17 user nova-compute[73450]:       <mac address="fa:16:3e:e0:87:92"/>
Aug 16 16:44:17 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:17 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:44:17 user nova-compute[73450]:       <target dev="tap40122be5-d7"/>
Aug 16 16:44:17 user nova-compute[73450]:     </interface>
Aug 16 16:44:17 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:44:17 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/console.log" append="off"/>
Aug 16 16:44:17 user nova-compute[73450]:     </serial>
Aug 16 16:44:17 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:44:17 user nova-compute[73450]:     <video>
Aug 16 16:44:17 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:17 user nova-compute[73450]:     </video>
Aug 16 16:44:17 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:44:17 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:44:17 user nova-compute[73450]:     </rng>
Aug 16 16:44:17 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:44:17 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:44:17 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:44:17 user nova-compute[73450]:     </memballoon>
Aug 16 16:44:17 user nova-compute[73450]:   </devices>
Aug 16 16:44:17 user nova-compute[73450]: </domain>
Aug 16 16:44:17 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance destroyed successfully.
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:e0:87:92, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:44:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-ad9bd552-3cbf-4039-bdf0-29bb60adeb8f req-e04fb4e9-bfdc-4092-b7b8-9752492bfb24 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ad9bd552-3cbf-4039-bdf0-29bb60adeb8f req-e04fb4e9-bfdc-4092-b7b8-9752492bfb24 service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ad9bd552-3cbf-4039-bdf0-29bb60adeb8f req-e04fb4e9-bfdc-4092-b7b8-9752492bfb24 service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ad9bd552-3cbf-4039-bdf0-29bb60adeb8f req-e04fb4e9-bfdc-4092-b7b8-9752492bfb24 service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-ad9bd552-3cbf-4039-bdf0-29bb60adeb8f req-e04fb4e9-bfdc-4092-b7b8-9752492bfb24 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:18 user nova-compute[73450]: WARNING nova.compute.manager [req-ad9bd552-3cbf-4039-bdf0-29bb60adeb8f req-e04fb4e9-bfdc-4092-b7b8-9752492bfb24 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state active and task_state rescuing.
Aug 16 16:44:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:20 user nova-compute[73450]: WARNING nova.compute.manager [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state active and task_state rescuing.
Aug 16 16:44:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:20 user nova-compute[73450]: WARNING nova.compute.manager [req-2cbb3386-7d88-4c08-8318-452f344c0885 req-1e09a123-7dfe-4a2c-bb0a-c7e791471f4b service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state active and task_state rescuing.
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for d1731c4d-0c63-4394-b50e-2db9c23a6951 due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204261.8097918, d1731c4d-0c63-4394-b50e-2db9c23a6951 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] VM Resumed (Lifecycle Event)
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c155add9-3585-40cf-9961-1df267fa07db tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204261.815685, d1731c4d-0c63-4394-b50e-2db9c23a6951 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] VM Started (Lifecycle Event)
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:24 user nova-compute[73450]: INFO nova.compute.manager [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Terminating instance
Aug 16 16:44:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-b245d263-fb7e-43f7-b225-958ffb32058a req-6bbd4719-bc25-4738-a716-2c96921a224d service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-unplugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b245d263-fb7e-43f7-b225-958ffb32058a req-6bbd4719-bc25-4738-a716-2c96921a224d service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b245d263-fb7e-43f7-b225-958ffb32058a req-6bbd4719-bc25-4738-a716-2c96921a224d service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b245d263-fb7e-43f7-b225-958ffb32058a req-6bbd4719-bc25-4738-a716-2c96921a224d service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-b245d263-fb7e-43f7-b225-958ffb32058a req-6bbd4719-bc25-4738-a716-2c96921a224d service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-unplugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-b245d263-fb7e-43f7-b225-958ffb32058a req-6bbd4719-bc25-4738-a716-2c96921a224d service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-unplugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Instance destroyed successfully.
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lazy-loading 'resources' on Instance uuid 032e6ee8-4545-4867-a8ed-4076ed273174 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-854210172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1778060136',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGQW4pBqszV7GkT1DSqckRZr1tzOMllClEWD6zRoXgdh3JcdTpIdPRXKM3Rx82f0o7HhR4UciWWoPevsp5DyJaK5ckZnot8UqNXmT795b50ZFx8Z7y7dSRpvnbQLaQ5ow==',key_name='tempest-keypair-400554828',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:42:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41319fdc350640e18bd748deb70a3efc',ramdisk_id='',reservation_id='r-4z9dgjse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-592429353',owner_user_name='tempest-ServerActionsV293TestJSON-592429353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1d1da8ff1204e8490b25aa909744e65',uuid=032e6ee8-4545-4867-a8ed-4076ed273174,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converting VIF {"id": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "address": "fa:16:3e:c3:27:33", "network": {"id": "e8dbe594-1941-49b2-b464-9d92ebe18be9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480744657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41319fdc350640e18bd748deb70a3efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1895c3ed-6e", "ovs_interfaceid": "1895c3ed-6e8a-4cab-9eb9-d54458cb589f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_vif [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1895c3ed-6e, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:44:25 user nova-compute[73450]: INFO os_vif [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:33,bridge_name='br-int',has_traffic_filtering=True,id=1895c3ed-6e8a-4cab-9eb9-d54458cb589f,network=Network(e8dbe594-1941-49b2-b464-9d92ebe18be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1895c3ed-6e')
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOLdAwYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:44:25 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3121add9-6d52-42ec-a812-430010294044]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf6bc1-0bcf-488c-be05-bcb4303d0336]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:44:25 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:44:25 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:44:25 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:44:25 user nova-compute[73450]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 (non-flash)
Aug 16 16:44:25 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:44:25 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2707b5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9'): ({'sdi'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Removing single pathed devices sdi {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03c24bd-ce75-40d2-a692-727af2316fb9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b46190-a1d0-4ac6-96b8-d4a1c4c79ca1]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Flushing IO for device /dev/sdi {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f0c339-d6b2-4013-8fc3-5138a037b3d5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9d9e88-4300-44ae-8bf4-a55a4280e4ff]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] SCSI volumes sdi have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8cc3c382-b09b75f4295f5e7a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8cc3c382', '/dev/disk/by-id/scsi-26230396237356634') {{(pid=84237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3414cb5d-fc81-430c-a50f-811299a213f2]: (4, None) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e212c7d3-cd49-430d-a660-f242916029b7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed3126-c819-479b-9a2e-cb5e17138483]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260]
Aug 16 16:44:25 user nova-compute[73450]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9, portal: 172.16.0.220,3260] successful.
Aug 16 16:44:25 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271210ae-b56b-4e19-a04a-c53c352dd3a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e4763-4b5e-4124-b271-b13496a98612]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] <== disconnect_volume: return (339ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:44:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Deleting instance files /opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174_del
Aug 16 16:44:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Deletion of /opt/stack/data/nova/instances/032e6ee8-4545-4867-a8ed-4076ed273174_del complete
Aug 16 16:44:25 user nova-compute[73450]: INFO nova.compute.manager [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 16 16:44:25 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:44:25 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:44:26 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:26 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Took 0.94 seconds to deallocate network for instance.
Aug 16 16:44:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-f64af7fd-224b-4093-847f-bdf9b6904461 req-00e5f75a-c275-4c44-b30d-ea67d9a647b7 service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-deleted-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-16580284-b1e0-44f2-b873-b4ff2dd0accb req-2cd53aba-d854-457c-8aba-b20ed3721a6e service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-16580284-b1e0-44f2-b873-b4ff2dd0accb req-2cd53aba-d854-457c-8aba-b20ed3721a6e service nova] Acquiring lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-16580284-b1e0-44f2-b873-b4ff2dd0accb req-2cd53aba-d854-457c-8aba-b20ed3721a6e service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-16580284-b1e0-44f2-b873-b4ff2dd0accb req-2cd53aba-d854-457c-8aba-b20ed3721a6e service nova] Lock "032e6ee8-4545-4867-a8ed-4076ed273174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-16580284-b1e0-44f2-b873-b4ff2dd0accb req-2cd53aba-d854-457c-8aba-b20ed3721a6e service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] No waiting events found dispatching network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:27 user nova-compute[73450]: WARNING nova.compute.manager [req-16580284-b1e0-44f2-b873-b4ff2dd0accb req-2cd53aba-d854-457c-8aba-b20ed3721a6e service nova] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Received unexpected event network-vif-plugged-1895c3ed-6e8a-4cab-9eb9-d54458cb589f for instance with vm_state active and task_state deleting.
Aug 16 16:44:27 user nova-compute[73450]: INFO nova.compute.manager [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 16:44:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Deleting volume: 271210ae-b56b-4e19-a04a-c53c352dd3a9 {{(pid=73450) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:28 user nova-compute[73450]: INFO nova.compute.manager [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Terminating instance
Aug 16 16:44:28 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:28 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Deleted allocations for instance 032e6ee8-4545-4867-a8ed-4076ed273174
Aug 16 16:44:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c79b59e7-45f5-4bc6-ac62-0db1ca296c48 tempest-ServerActionsV293TestJSON-592429353 tempest-ServerActionsV293TestJSON-592429353-project-member] Lock "032e6ee8-4545-4867-a8ed-4076ed273174" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.040s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:29 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Instance destroyed successfully.
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.objects.instance [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'resources' on Instance uuid 91abba0d-17da-4d78-8e2b-b3b741e465d5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-694310296',display_name='tempest-VolumesAdminNegativeTest-server-694310296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-694310296',id=15,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7478d576cef940d38c222b5e2de1b8f0',ramdisk_id='',reservation_id='r-7wz28lal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1290942672',owner_user_name='tempest-VolumesAdminNegativeTest-1290942672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:42:34Z,user_data=None,user_id='bb9ce31454384235b35cb8dd1e257364',uuid=91abba0d-17da-4d78-8e2b-b3b741e465d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converting VIF {"id": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "address": "fa:16:3e:21:06:16", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef8e556-a5", "ovs_interfaceid": "bef8e556-a5d2-4c37-b9cd-aed76dc39ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG os_vif [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef8e556-a5, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:44:29 user nova-compute[73450]: INFO os_vif [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:16,bridge_name='br-int',has_traffic_filtering=True,id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef8e556-a5')
Aug 16 16:44:29 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Deleting instance files /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5_del
Aug 16 16:44:29 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Deletion of /opt/stack/data/nova/instances/91abba0d-17da-4d78-8e2b-b3b741e465d5_del complete
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-vif-unplugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] No waiting events found dispatching network-vif-unplugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-vif-unplugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] Acquiring lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] No waiting events found dispatching network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:29 user nova-compute[73450]: WARNING nova.compute.manager [req-b3ae7af2-08cc-459d-919f-8d4ae7dc9c65 req-4ed5ae5d-ffdc-45d1-86e0-3112d35547da service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received unexpected event network-vif-plugged-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 for instance with vm_state active and task_state deleting.
Aug 16 16:44:29 user nova-compute[73450]: INFO nova.compute.manager [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:29 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Took 0.66 seconds to deallocate network for instance.
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-36fdb2eb-aaa8-4bf4-aa09-aedc6cd50947 req-56f9ee53-5b09-4582-bba7-0873cf4740ac service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Received event network-vif-deleted-bef8e556-a5d2-4c37-b9cd-aed76dc39ef1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:29 user nova-compute[73450]: INFO nova.compute.manager [req-36fdb2eb-aaa8-4bf4-aa09-aedc6cd50947 req-56f9ee53-5b09-4582-bba7-0873cf4740ac service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Neutron deleted interface bef8e556-a5d2-4c37-b9cd-aed76dc39ef1; detaching it from the instance and deleting it from the info cache
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-36fdb2eb-aaa8-4bf4-aa09-aedc6cd50947 req-56f9ee53-5b09-4582-bba7-0873cf4740ac service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-36fdb2eb-aaa8-4bf4-aa09-aedc6cd50947 req-56f9ee53-5b09-4582-bba7-0873cf4740ac service nova] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Detach interface failed, port_id=bef8e556-a5d2-4c37-b9cd-aed76dc39ef1, reason: Instance 91abba0d-17da-4d78-8e2b-b3b741e465d5 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:30 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:44:30 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:44:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:30 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Deleted allocations for instance 91abba0d-17da-4d78-8e2b-b3b741e465d5
Aug 16 16:44:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4d2eef00-c708-45a4-b58d-ceb696ffa0bc tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "91abba0d-17da-4d78-8e2b-b3b741e465d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.337s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:34 user nova-compute[73450]: INFO nova.compute.manager [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Rescuing
Aug 16 16:44:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:44:35 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-57c09803-615f-4446-9fdf-154d845d9a67 req-5dd9435b-4a41-4823-be30-a6dbef77769d service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-57c09803-615f-4446-9fdf-154d845d9a67 req-5dd9435b-4a41-4823-be30-a6dbef77769d service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-57c09803-615f-4446-9fdf-154d845d9a67 req-5dd9435b-4a41-4823-be30-a6dbef77769d service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-57c09803-615f-4446-9fdf-154d845d9a67 req-5dd9435b-4a41-4823-be30-a6dbef77769d service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-57c09803-615f-4446-9fdf-154d845d9a67 req-5dd9435b-4a41-4823-be30-a6dbef77769d service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:36 user nova-compute[73450]: WARNING nova.compute.manager [req-57c09803-615f-4446-9fdf-154d845d9a67 req-5dd9435b-4a41-4823-be30-a6dbef77769d service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state active and task_state rescuing.
Aug 16 16:44:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance destroyed successfully.
Aug 16 16:44:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Attempting a stable device rescue
Aug 16 16:44:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73450) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:44:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Creating image(s)
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "/opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'trusted_certs' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "1ba85543d36f740d1f3b363430bc64a6563a0795" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1ba85543d36f740d1f3b363430bc64a6563a0795" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG nova.virt.images [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] 6bfa1e94-399f-4566-ad19-35d64bc267eb was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.part /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.part /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.converted" returned: 0 in 0.562s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-dafad72c-6b9c-4516-bc2f-5d763271e83b req-03bbd0ff-7197-4a0a-9d24-f2d843949dac service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dafad72c-6b9c-4516-bc2f-5d763271e83b req-03bbd0ff-7197-4a0a-9d24-f2d843949dac service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dafad72c-6b9c-4516-bc2f-5d763271e83b req-03bbd0ff-7197-4a0a-9d24-f2d843949dac service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dafad72c-6b9c-4516-bc2f-5d763271e83b req-03bbd0ff-7197-4a0a-9d24-f2d843949dac service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-dafad72c-6b9c-4516-bc2f-5d763271e83b req-03bbd0ff-7197-4a0a-9d24-f2d843949dac service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:38 user nova-compute[73450]: WARNING nova.compute.manager [req-dafad72c-6b9c-4516-bc2f-5d763271e83b req-03bbd0ff-7197-4a0a-9d24-f2d843949dac service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state active and task_state rescuing.
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1ba85543d36f740d1f3b363430bc64a6563a0795" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.965s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "1ba85543d36f740d1f3b363430bc64a6563a0795" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1ba85543d36f740d1f3b363430bc64a6563a0795" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795 --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795,backing_fmt=raw /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795,backing_fmt=raw /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue" returned: 0 in 0.057s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1ba85543d36f740d1f3b363430bc64a6563a0795" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'migration_context' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Start _get_guest_xml network_info=[{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "vif_mac": "fa:16:3e:cc:c6:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6bfa1e94-399f-4566-ad19-35d64bc267eb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'e64cc8eb-bb4b-488b-bfeb-6e5625fe01b4', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '78128529-664d-4e24-9a7b-a242e67a2ddf', 'attached_at': '', 'detached_at': '', 'volume_id': '578ef01e-d82e-4971-b5a5-623d8ccd30aa', 'serial': '578ef01e-d82e-4971-b5a5-623d8ccd30aa'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'resources' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'numa_topology' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:39 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:39 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:44:39 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:44:39 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:44:39 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e415e-fd5e-4dcd-a4a7-cf3bb7719052]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ywLMnsDR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 16:44:39 user nova-compute[73450]: node.name = iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa
Aug 16 16:44:39 user nova-compute[73450]: node.tpgt = -1
Aug 16 16:44:39 user nova-compute[73450]: node.startup = automatic
Aug 16 16:44:39 user nova-compute[73450]: node.leading_login = No
Aug 16 16:44:39 user nova-compute[73450]: iface.iscsi_ifacename = default
Aug 16 16:44:39 user nova-compute[73450]: iface.net_ifacename = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.ipaddress = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.prefix_len = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.hwaddress = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.transport_name = tcp
Aug 16 16:44:39 user nova-compute[73450]: iface.initiatorname = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.vlan_id = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.vlan_priority = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.vlan_state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.iface_num = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.mtu = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.port = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.bootproto = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.subnet_mask = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.gateway = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_alt_client_id = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_dns = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_learn_iqn = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_vendor_id_state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_vendor_id = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.dhcp_slp_da = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.fragmentation = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.gratuitous_arp = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.incoming_forwarding = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.tos_state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.tos = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.ttl = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.delayed_ack = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.tcp_nagle = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.tcp_wsf_state = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.tcp_wsf = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.tcp_timer_scale = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.tcp_timestamp = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.redirect = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.def_task_mgmt_timeout = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.header_digest = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.data_digest = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.immediate_data = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.initial_r2t = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.data_seq_inorder = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.data_pdu_inorder = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.erl = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.max_receive_data_len = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.first_burst_len = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.max_outstanding_r2t = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.max_burst_len = 0
Aug 16 16:44:39 user nova-compute[73450]: iface.chap_auth = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.bidi_chap = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.strict_login_compliance = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.discovery_auth = <empty>
Aug 16 16:44:39 user nova-compute[73450]: iface.discovery_logout = <empty>
Aug 16 16:44:39 user nova-compute[73450]: node.discovery_address = <empty>
Aug 16 16:44:39 user nova-compute[73450]: node.discovery_port = 0
Aug 16 16:44:39 user nova-compute[73450]: node.discovery_type = static
Aug 16 16:44:39 user nova-compute[73450]: node.session.initial_cmdsn = 0
Aug 16 16:44:39 user nova-compute[73450]: node.session.initial_login_retry_max = 8
Aug 16 16:44:39 user nova-compute[73450]: node.session.xmit_thread_priority = -20
Aug 16 16:44:39 user nova-compute[73450]: node.session.cmds_max = 128
Aug 16 16:44:39 user nova-compute[73450]: node.session.queue_depth = 32
Aug 16 16:44:39 user nova-compute[73450]: node.session.nr_sessions = 1
Aug 16 16:44:39 user nova-compute[73450]: node.session.auth.authmethod = CHAP
Aug 16 16:44:39 user nova-compute[73450]: node.session.auth.username = ywLMnsDR
Aug 16 16:44:39 user nova-compute[73450]: node.session.auth.password = ***
Aug 16 16:44:39 user nova-compute[73450]: node.session.auth.username_in = <empty>
Aug 16 16:44:39 user nova-compute[73450]: node.session.auth.password_in = <empty>
Aug 16 16:44:39 user nova-compute[73450]: node.session.auth.chap_algs = MD5
Aug 16 16:44:39 user nova-compute[73450]: node.session.timeo.replacement_timeout = 120
Aug 16 16:44:39 user nova-compute[73450]: node.session.err_timeo.abort_timeout = 15
Aug 16 16:44:39 user nova-compute[73450]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 16:44:39 user nova-compute[73450]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 16:44:39 user nova-compute[73450]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.FastAbort = Yes
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.InitialR2T = No
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.ImmediateData = Yes
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.MaxConnections = 1
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 16:44:39 user nova-compute[73450]: node.session.iscsi.ERL = 0
Aug 16 16:44:39 user nova-compute[73450]: node.session.scan = manual
Aug 16 16:44:39 user nova-compute[73450]: node.session.reopen_max = 0
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].address = 172.16.0.220
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].port = 3260
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].startup = manual
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].tcp.window_size = 524288
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].tcp.type_of_service = 0
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].timeo.logout_timeout = 15
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].timeo.login_timeout = 15
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].timeo.auth_timeout = 45
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].iscsi.DataDigest = None
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].iscsi.IFMarker = No
Aug 16 16:44:39 user nova-compute[73450]: node.conn[0].iscsi.OFMarker = No
Aug 16 16:44:39 user nova-compute[73450]: # END RECORD
Aug 16 16:44:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d398a3ba-01d0-4224-9c74-a488a10594fc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7bba19-92ba-493a-be85-73d47eccdefa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywLMnsDR {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywLMnsDR" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[566aadb4-3345-4ee7-a4e0-3876b3290a86]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ywLMnsDR'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e310c07-b477-4ad6-91d6-50cbc6e12fd3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a8edfd-4e61-4b2f-bbfe-a852686827d0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:44:39 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:44:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:44:39 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:44:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] HCTL ('41', '0', '0', 0) found on session 20 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Scanning host 41 c: 0, t: 0, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddab9d3-0b4f-47ea-af0e-fea00436c117]: (4, ('0 0 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching for a device in session 20 and hctl ('41', '0', '0', 0) yield: sdj {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23936323430666562', 'path': '/dev/sdj'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936323430666562', 'path': '/dev/sdj'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033664467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033664467',id=16,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-d6yxi6ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:43:21Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=78128529-664d-4e24-9a7b-a242e67a2ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "vif_mac": "fa:16:3e:cc:c6:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "vif_mac": "fa:16:3e:cc:c6:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'pci_devices' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:44:39 user nova-compute[73450]:   <uuid>78128529-664d-4e24-9a7b-a242e67a2ddf</uuid>
Aug 16 16:44:39 user nova-compute[73450]:   <name>instance-00000010</name>
Aug 16 16:44:39 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:44:39 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:44:39 user nova-compute[73450]:   <metadata>
Aug 16 16:44:39 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:44:39 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:44:39 user nova-compute[73450]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2033664467</nova:name>
Aug 16 16:44:39 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:44:39</nova:creationTime>
Aug 16 16:44:39 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:44:39 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:44:39 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:44:39 user nova-compute[73450]:       <nova:owner>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:user uuid="3275ae2aaad34aa8adb49e5de0dbe238">tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member</nova:user>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:project uuid="88f813e9d59945b58a7f0141fb29ca46">tempest-ServerBootFromVolumeStableRescueTest-311543227</nova:project>
Aug 16 16:44:39 user nova-compute[73450]:       </nova:owner>
Aug 16 16:44:39 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:44:39 user nova-compute[73450]:       <nova:ports>
Aug 16 16:44:39 user nova-compute[73450]:         <nova:port uuid="6a7c11f4-7da8-438a-847f-31ccfd4eceea">
Aug 16 16:44:39 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 16:44:39 user nova-compute[73450]:         </nova:port>
Aug 16 16:44:39 user nova-compute[73450]:       </nova:ports>
Aug 16 16:44:39 user nova-compute[73450]:     </nova:instance>
Aug 16 16:44:39 user nova-compute[73450]:   </metadata>
Aug 16 16:44:39 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:44:39 user nova-compute[73450]:     <system>
Aug 16 16:44:39 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:44:39 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:44:39 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:44:39 user nova-compute[73450]:       <entry name="serial">78128529-664d-4e24-9a7b-a242e67a2ddf</entry>
Aug 16 16:44:39 user nova-compute[73450]:       <entry name="uuid">78128529-664d-4e24-9a7b-a242e67a2ddf</entry>
Aug 16 16:44:39 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:44:39 user nova-compute[73450]:     </system>
Aug 16 16:44:39 user nova-compute[73450]:   </sysinfo>
Aug 16 16:44:39 user nova-compute[73450]:   <os>
Aug 16 16:44:39 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:44:39 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:44:39 user nova-compute[73450]:   </os>
Aug 16 16:44:39 user nova-compute[73450]:   <features>
Aug 16 16:44:39 user nova-compute[73450]:     <acpi/>
Aug 16 16:44:39 user nova-compute[73450]:     <apic/>
Aug 16 16:44:39 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:44:39 user nova-compute[73450]:   </features>
Aug 16 16:44:39 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:44:39 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:44:39 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:44:39 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:44:39 user nova-compute[73450]:   </clock>
Aug 16 16:44:39 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:44:39 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:44:39 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:44:39 user nova-compute[73450]:   </cpu>
Aug 16 16:44:39 user nova-compute[73450]:   <devices>
Aug 16 16:44:39 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:44:39 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:44:39 user nova-compute[73450]:       <source dev="/dev/sdj"/>
Aug 16 16:44:39 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:44:39 user nova-compute[73450]:       <serial>578ef01e-d82e-4971-b5a5-623d8ccd30aa</serial>
Aug 16 16:44:39 user nova-compute[73450]:     </disk>
Aug 16 16:44:39 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:44:39 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:44:39 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue"/>
Aug 16 16:44:39 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:44:39 user nova-compute[73450]:       <boot order="1"/>
Aug 16 16:44:39 user nova-compute[73450]:     </disk>
Aug 16 16:44:39 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:44:39 user nova-compute[73450]:       <mac address="fa:16:3e:cc:c6:ee"/>
Aug 16 16:44:39 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:39 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:44:39 user nova-compute[73450]:       <target dev="tap6a7c11f4-7d"/>
Aug 16 16:44:39 user nova-compute[73450]:     </interface>
Aug 16 16:44:39 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:44:39 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/console.log" append="off"/>
Aug 16 16:44:39 user nova-compute[73450]:     </serial>
Aug 16 16:44:39 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:44:39 user nova-compute[73450]:     <video>
Aug 16 16:44:39 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:39 user nova-compute[73450]:     </video>
Aug 16 16:44:39 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:44:39 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:44:39 user nova-compute[73450]:     </rng>
Aug 16 16:44:39 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:44:39 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:44:39 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:44:39 user nova-compute[73450]:     </memballoon>
Aug 16 16:44:39 user nova-compute[73450]:   </devices>
Aug 16 16:44:39 user nova-compute[73450]: </domain>
Aug 16 16:44:39 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:44:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance destroyed successfully.
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No VIF found with MAC fa:16:3e:cc:c6:ee, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204265.2697663, 032e6ee8-4545-4867-a8ed-4076ed273174 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:40 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] VM Stopped (Lifecycle Event)
Aug 16 16:44:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c2bc9da8-48c7-4951-a088-15084d933692 None None] [instance: 032e6ee8-4545-4867-a8ed-4076ed273174] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-3dc6f456-5c4b-4078-8b3b-c3d4cf3d89ca req-00f62737-e0cb-4846-a1fa-df65612ca7ec service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3dc6f456-5c4b-4078-8b3b-c3d4cf3d89ca req-00f62737-e0cb-4846-a1fa-df65612ca7ec service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3dc6f456-5c4b-4078-8b3b-c3d4cf3d89ca req-00f62737-e0cb-4846-a1fa-df65612ca7ec service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3dc6f456-5c4b-4078-8b3b-c3d4cf3d89ca req-00f62737-e0cb-4846-a1fa-df65612ca7ec service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-3dc6f456-5c4b-4078-8b3b-c3d4cf3d89ca req-00f62737-e0cb-4846-a1fa-df65612ca7ec service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:41 user nova-compute[73450]: WARNING nova.compute.manager [req-3dc6f456-5c4b-4078-8b3b-c3d4cf3d89ca req-00f62737-e0cb-4846-a1fa-df65612ca7ec service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state active and task_state rescuing.
Aug 16 16:44:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 78128529-664d-4e24-9a7b-a242e67a2ddf due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204283.2090015, 78128529-664d-4e24-9a7b-a242e67a2ddf => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:43 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Resumed (Lifecycle Event)
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f88021cc-17e7-4070-9766-8d0a4fdddcec tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-089ab2f8-c7c5-4f51-8442-03572a0a43ec req-f69f2d01-501e-4394-ac5a-2a8f871539b2 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-089ab2f8-c7c5-4f51-8442-03572a0a43ec req-f69f2d01-501e-4394-ac5a-2a8f871539b2 service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-089ab2f8-c7c5-4f51-8442-03572a0a43ec req-f69f2d01-501e-4394-ac5a-2a8f871539b2 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-089ab2f8-c7c5-4f51-8442-03572a0a43ec req-f69f2d01-501e-4394-ac5a-2a8f871539b2 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-089ab2f8-c7c5-4f51-8442-03572a0a43ec req-f69f2d01-501e-4394-ac5a-2a8f871539b2 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:43 user nova-compute[73450]: WARNING nova.compute.manager [req-089ab2f8-c7c5-4f51-8442-03572a0a43ec req-f69f2d01-501e-4394-ac5a-2a8f871539b2 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state active and task_state rescuing.
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:43 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204283.2098925, 78128529-664d-4e24-9a7b-a242e67a2ddf => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:43 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Started (Lifecycle Event)
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204269.0055397, 91abba0d-17da-4d78-8e2b-b3b741e465d5 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:44:44 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] VM Stopped (Lifecycle Event)
Aug 16 16:44:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-64e725a3-945e-41f2-b40c-82e51ba943a0 None None] [instance: 91abba0d-17da-4d78-8e2b-b3b741e465d5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:44:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:47 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:47 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7449MB free_disk=24.182029724121094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 42484cde-66d6-4816-962b-912f6df59156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance ada60a07-c8f4-4dd6-a68e-a46121493bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:44:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:44:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:44:54 user nova-compute[73450]: INFO nova.compute.claims [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Claim successful on node user
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:44:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.policy [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ed98f68e9e04991817ddf00c2c3cb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6dfde9621b946408c11bcf2465a9a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:44:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Creating image(s)
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.210s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.247s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk 1073741824" returned: 0 in 0.050s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Cannot resize image /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'migration_context' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Ensure instance console log exists: /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Successfully created port: c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:44:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Successfully updated port: c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing instance network info cache due to event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance network_info: |[{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.neutron [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Start _get_guest_xml network_info=[{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:44:57 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:57 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018494408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018494408',id=19,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi0AjEzjAp0y9wC6wtaJb6A8GOtK4WEmiGjVIByW/okJacDOnQ3MnbPq65C/qNlF+LYqmS/3wwM7Uix6eMtBwtBkeuHUCNQ9gnSimuX4aG+LYX5HeONxRsFiKnu2L6aZw==',key_name='tempest-keypair-1720053238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-5dj8p0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=93e6b212-411d-408e-94a2-37a64232f8e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.objects.instance [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:44:57 user nova-compute[73450]:   <uuid>93e6b212-411d-408e-94a2-37a64232f8e5</uuid>
Aug 16 16:44:57 user nova-compute[73450]:   <name>instance-00000013</name>
Aug 16 16:44:57 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:44:57 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:44:57 user nova-compute[73450]:   <metadata>
Aug 16 16:44:57 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:44:57 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:44:57 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1018494408</nova:name>
Aug 16 16:44:57 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:44:57</nova:creationTime>
Aug 16 16:44:57 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:44:57 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:44:57 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:44:57 user nova-compute[73450]:       <nova:owner>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:user uuid="2ed98f68e9e04991817ddf00c2c3cb0e">tempest-AttachVolumeShelveTestJSON-405972124-project-member</nova:user>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:project uuid="c6dfde9621b946408c11bcf2465a9a3d">tempest-AttachVolumeShelveTestJSON-405972124</nova:project>
Aug 16 16:44:57 user nova-compute[73450]:       </nova:owner>
Aug 16 16:44:57 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:44:57 user nova-compute[73450]:       <nova:ports>
Aug 16 16:44:57 user nova-compute[73450]:         <nova:port uuid="c1b77572-0f96-4d2f-958d-238e07b02809">
Aug 16 16:44:57 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:44:57 user nova-compute[73450]:         </nova:port>
Aug 16 16:44:57 user nova-compute[73450]:       </nova:ports>
Aug 16 16:44:57 user nova-compute[73450]:     </nova:instance>
Aug 16 16:44:57 user nova-compute[73450]:   </metadata>
Aug 16 16:44:57 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:44:57 user nova-compute[73450]:     <system>
Aug 16 16:44:57 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:44:57 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:44:57 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:44:57 user nova-compute[73450]:       <entry name="serial">93e6b212-411d-408e-94a2-37a64232f8e5</entry>
Aug 16 16:44:57 user nova-compute[73450]:       <entry name="uuid">93e6b212-411d-408e-94a2-37a64232f8e5</entry>
Aug 16 16:44:57 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:44:57 user nova-compute[73450]:     </system>
Aug 16 16:44:57 user nova-compute[73450]:   </sysinfo>
Aug 16 16:44:57 user nova-compute[73450]:   <os>
Aug 16 16:44:57 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:44:57 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:44:57 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:44:57 user nova-compute[73450]:   </os>
Aug 16 16:44:57 user nova-compute[73450]:   <features>
Aug 16 16:44:57 user nova-compute[73450]:     <acpi/>
Aug 16 16:44:57 user nova-compute[73450]:     <apic/>
Aug 16 16:44:57 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:44:57 user nova-compute[73450]:   </features>
Aug 16 16:44:57 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:44:57 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:44:57 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:44:57 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:44:57 user nova-compute[73450]:   </clock>
Aug 16 16:44:57 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:44:57 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:44:57 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:44:57 user nova-compute[73450]:   </cpu>
Aug 16 16:44:57 user nova-compute[73450]:   <devices>
Aug 16 16:44:57 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:44:57 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:44:57 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk"/>
Aug 16 16:44:57 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:44:57 user nova-compute[73450]:     </disk>
Aug 16 16:44:57 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:44:57 user nova-compute[73450]:       <mac address="fa:16:3e:68:62:ee"/>
Aug 16 16:44:57 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:57 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:44:57 user nova-compute[73450]:       <target dev="tapc1b77572-0f"/>
Aug 16 16:44:57 user nova-compute[73450]:     </interface>
Aug 16 16:44:57 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:44:57 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/console.log" append="off"/>
Aug 16 16:44:57 user nova-compute[73450]:     </serial>
Aug 16 16:44:57 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:44:57 user nova-compute[73450]:     <video>
Aug 16 16:44:57 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:44:57 user nova-compute[73450]:     </video>
Aug 16 16:44:57 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:44:57 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:44:57 user nova-compute[73450]:     </rng>
Aug 16 16:44:57 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:44:57 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:44:57 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:44:57 user nova-compute[73450]:     </memballoon>
Aug 16 16:44:57 user nova-compute[73450]:   </devices>
Aug 16 16:44:57 user nova-compute[73450]: </domain>
Aug 16 16:44:57 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018494408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018494408',id=19,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi0AjEzjAp0y9wC6wtaJb6A8GOtK4WEmiGjVIByW/okJacDOnQ3MnbPq65C/qNlF+LYqmS/3wwM7Uix6eMtBwtBkeuHUCNQ9gnSimuX4aG+LYX5HeONxRsFiKnu2L6aZw==',key_name='tempest-keypair-1720053238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-5dj8p0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=93e6b212-411d-408e-94a2-37a64232f8e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG os_vif [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1b77572-0f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1b77572-0f, col_values=(('external_ids', {'iface-id': 'c1b77572-0f96-4d2f-958d-238e07b02809', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:62:ee', 'vm-uuid': '93e6b212-411d-408e-94a2-37a64232f8e5'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:57 user nova-compute[73450]: INFO os_vif [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f')
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:44:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No VIF found with MAC fa:16:3e:68:62:ee, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:44:58 user nova-compute[73450]: DEBUG nova.network.neutron [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updated VIF entry in instance network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:44:58 user nova-compute[73450]: DEBUG nova.network.neutron [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:44:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac33e5bc-c3e9-4675-a493-cb11f254db7b req-d8a503ae-087a-454c-860d-2600508dd53f service nova] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-0c1f6213-f392-4c18-a533-29e8830a54f5 req-2b32b0eb-4e81-4417-ad2a-92172198ac84 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c1f6213-f392-4c18-a533-29e8830a54f5 req-2b32b0eb-4e81-4417-ad2a-92172198ac84 service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c1f6213-f392-4c18-a533-29e8830a54f5 req-2b32b0eb-4e81-4417-ad2a-92172198ac84 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0c1f6213-f392-4c18-a533-29e8830a54f5 req-2b32b0eb-4e81-4417-ad2a-92172198ac84 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-0c1f6213-f392-4c18-a533-29e8830a54f5 req-2b32b0eb-4e81-4417-ad2a-92172198ac84 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:44:59 user nova-compute[73450]: WARNING nova.compute.manager [req-0c1f6213-f392-4c18-a533-29e8830a54f5 req-2b32b0eb-4e81-4417-ad2a-92172198ac84 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state building and task_state spawning.
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:44:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-08287db4-ff26-4176-8fb9-5731ca71e6cf req-1f7f1027-b805-4554-be35-163270cec919 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-08287db4-ff26-4176-8fb9-5731ca71e6cf req-1f7f1027-b805-4554-be35-163270cec919 service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-08287db4-ff26-4176-8fb9-5731ca71e6cf req-1f7f1027-b805-4554-be35-163270cec919 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-08287db4-ff26-4176-8fb9-5731ca71e6cf req-1f7f1027-b805-4554-be35-163270cec919 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-08287db4-ff26-4176-8fb9-5731ca71e6cf req-1f7f1027-b805-4554-be35-163270cec919 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:01 user nova-compute[73450]: WARNING nova.compute.manager [req-08287db4-ff26-4176-8fb9-5731ca71e6cf req-1f7f1027-b805-4554-be35-163270cec919 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state building and task_state spawning.
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204301.4021454, 93e6b212-411d-408e-94a2-37a64232f8e5 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] VM Resumed (Lifecycle Event)
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance spawned successfully.
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204301.4029841, 93e6b212-411d-408e-94a2-37a64232f8e5 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] VM Started (Lifecycle Event)
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 16 16:45:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:45:01 user nova-compute[73450]: INFO nova.compute.manager [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Took 7.51 seconds to build instance.
Aug 16 16:45:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-08f6b615-4582-41d3-a1c4-df07a2d48415 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.626s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:25 user nova-compute[73450]: INFO nova.compute.manager [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Terminating instance
Aug 16 16:45:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe1aae78-0469-402c-a929-ea4ed7b53002 req-6f2ac0b3-5891-4cc6-81a7-36c78ecf73f1 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-vif-unplugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe1aae78-0469-402c-a929-ea4ed7b53002 req-6f2ac0b3-5891-4cc6-81a7-36c78ecf73f1 service nova] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe1aae78-0469-402c-a929-ea4ed7b53002 req-6f2ac0b3-5891-4cc6-81a7-36c78ecf73f1 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe1aae78-0469-402c-a929-ea4ed7b53002 req-6f2ac0b3-5891-4cc6-81a7-36c78ecf73f1 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe1aae78-0469-402c-a929-ea4ed7b53002 req-6f2ac0b3-5891-4cc6-81a7-36c78ecf73f1 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] No waiting events found dispatching network-vif-unplugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe1aae78-0469-402c-a929-ea4ed7b53002 req-6f2ac0b3-5891-4cc6-81a7-36c78ecf73f1 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-vif-unplugged-10450674-e9c9-447e-b1ab-d53f226dae29 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:45:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] Instance destroyed successfully.
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lazy-loading 'resources' on Instance uuid 42484cde-66d6-4816-962b-912f6df59156 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1853776870',display_name='tempest-VolumesAdminNegativeTest-server-1853776870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1853776870',id=5,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4JHGAuQToGh3bh4Wmz4D5WtinAtOYht83bCTrlYP6XyUemCjGwhxUSz2GrDqiC/XVv6afOawoCvVHCC5bF7Q73NMK7eeRsSiQxkflM96ENYFcIbuzjaFp7YnMRYe0fgQ==',key_name='tempest-keypair-603146943',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7478d576cef940d38c222b5e2de1b8f0',ramdisk_id='',reservation_id='r-bmdhat5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1290942672',owner_user_name='tempest-VolumesAdminNegativeTest-1290942672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9ce31454384235b35cb8dd1e257364',uuid=42484cde-66d6-4816-962b-912f6df59156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converting VIF {"id": "10450674-e9c9-447e-b1ab-d53f226dae29", "address": "fa:16:3e:4f:5b:3a", "network": {"id": "2da2dd26-b6e9-4d5f-93be-5c60d4543cbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1639027544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7478d576cef940d38c222b5e2de1b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10450674-e9", "ovs_interfaceid": "10450674-e9c9-447e-b1ab-d53f226dae29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG os_vif [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10450674-e9, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:45:26 user nova-compute[73450]: INFO os_vif [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=10450674-e9c9-447e-b1ab-d53f226dae29,network=Network(2da2dd26-b6e9-4d5f-93be-5c60d4543cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10450674-e9')
Aug 16 16:45:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Deleting instance files /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156_del
Aug 16 16:45:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Deletion of /opt/stack/data/nova/instances/42484cde-66d6-4816-962b-912f6df59156_del complete
Aug 16 16:45:26 user nova-compute[73450]: INFO nova.compute.manager [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] [instance: 42484cde-66d6-4816-962b-912f6df59156] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 16 16:45:26 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:45:26 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:27 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] Took 0.94 seconds to deallocate network for instance.
Aug 16 16:45:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-e5bb0599-8bcb-4585-9924-367d5a9349e5 req-aaabc75c-8151-4db9-8f8f-41d04c7d8a22 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-vif-deleted-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:27 user nova-compute[73450]: INFO nova.compute.manager [req-e5bb0599-8bcb-4585-9924-367d5a9349e5 req-aaabc75c-8151-4db9-8f8f-41d04c7d8a22 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Neutron deleted interface 10450674-e9c9-447e-b1ab-d53f226dae29; detaching it from the instance and deleting it from the info cache
Aug 16 16:45:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-e5bb0599-8bcb-4585-9924-367d5a9349e5 req-aaabc75c-8151-4db9-8f8f-41d04c7d8a22 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-e5bb0599-8bcb-4585-9924-367d5a9349e5 req-aaabc75c-8151-4db9-8f8f-41d04c7d8a22 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Detach interface failed, port_id=10450674-e9c9-447e-b1ab-d53f226dae29, reason: Instance 42484cde-66d6-4816-962b-912f6df59156 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:45:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:27 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Deleted allocations for instance 42484cde-66d6-4816-962b-912f6df59156
Aug 16 16:45:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-570cb7d1-5db4-498a-b2e3-805627ac4395 tempest-VolumesAdminNegativeTest-1290942672 tempest-VolumesAdminNegativeTest-1290942672-project-member] Lock "42484cde-66d6-4816-962b-912f6df59156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-ba1cfcff-30c4-437e-90ae-7a9a2b79cf91 req-320ed5de-c938-4cf1-bd6b-543cb30382e4 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received event network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba1cfcff-30c4-437e-90ae-7a9a2b79cf91 req-320ed5de-c938-4cf1-bd6b-543cb30382e4 service nova] Acquiring lock "42484cde-66d6-4816-962b-912f6df59156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba1cfcff-30c4-437e-90ae-7a9a2b79cf91 req-320ed5de-c938-4cf1-bd6b-543cb30382e4 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba1cfcff-30c4-437e-90ae-7a9a2b79cf91 req-320ed5de-c938-4cf1-bd6b-543cb30382e4 service nova] Lock "42484cde-66d6-4816-962b-912f6df59156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-ba1cfcff-30c4-437e-90ae-7a9a2b79cf91 req-320ed5de-c938-4cf1-bd6b-543cb30382e4 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] No waiting events found dispatching network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:28 user nova-compute[73450]: WARNING nova.compute.manager [req-ba1cfcff-30c4-437e-90ae-7a9a2b79cf91 req-320ed5de-c938-4cf1-bd6b-543cb30382e4 service nova] [instance: 42484cde-66d6-4816-962b-912f6df59156] Received unexpected event network-vif-plugged-10450674-e9c9-447e-b1ab-d53f226dae29 for instance with vm_state deleted and task_state None.
Aug 16 16:45:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 66f48511-dafc-457b-817e-5bfe039cefa1 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 679cc7af-3bba-44b0-9d76-3f053f87dd80 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid eed98e2e-e225-483c-93bf-b8100e2bc5fe {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "66f48511-dafc-457b-817e-5bfe039cefa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "66f48511-dafc-457b-817e-5bfe039cefa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:31 user nova-compute[73450]: INFO nova.compute.manager [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Terminating instance
Aug 16 16:45:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3c3c54c-f86c-4015-899d-d90a981fd5d6 req-bd7f2daf-281e-464c-9899-c09293c55221 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-vif-unplugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3c3c54c-f86c-4015-899d-d90a981fd5d6 req-bd7f2daf-281e-464c-9899-c09293c55221 service nova] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3c3c54c-f86c-4015-899d-d90a981fd5d6 req-bd7f2daf-281e-464c-9899-c09293c55221 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b3c3c54c-f86c-4015-899d-d90a981fd5d6 req-bd7f2daf-281e-464c-9899-c09293c55221 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3c3c54c-f86c-4015-899d-d90a981fd5d6 req-bd7f2daf-281e-464c-9899-c09293c55221 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] No waiting events found dispatching network-vif-unplugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-b3c3c54c-f86c-4015-899d-d90a981fd5d6 req-bd7f2daf-281e-464c-9899-c09293c55221 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-vif-unplugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:31 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:45:31 user nova-compute[73450]: INFO nova.compute.claims [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Claim successful on node user
Aug 16 16:45:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Instance destroyed successfully.
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.objects.instance [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lazy-loading 'resources' on Instance uuid 6f285797-8d8a-4b6f-9f39-c79b71124f69 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405758879',display_name='tempest-TestVolumeSwap-server-405758879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405758879',id=6,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrvejGcvzLPwyJ1jY1zkiS140l66LNn4mce8ALDP5rYlFhPaZWSMERRIZw79HtHLg7bdAPYzS3qdr3l+SKqBz94Xc2wX7UDCEXDyrLQw5azwToIEcr3nDpUeTEPeTWjAA==',key_name='tempest-keypair-2079128480',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5c54782056d4249a0e5bb9bae2d35f7',ramdisk_id='',reservation_id='r-ps3hkpru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1170048861',owner_user_name='tempest-TestVolumeSwap-1170048861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3239db433fd64ee698d8c47071b12016',uuid=6f285797-8d8a-4b6f-9f39-c79b71124f69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Converting VIF {"id": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "address": "fa:16:3e:ac:8e:aa", "network": {"id": "d0aba411-7d97-41c5-a584-cebaee4503e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-166016897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5c54782056d4249a0e5bb9bae2d35f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab7a46b5-a5", "ovs_interfaceid": "ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_vif [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab7a46b5-a5, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:45:32 user nova-compute[73450]: INFO os_vif [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:8e:aa,bridge_name='br-int',has_traffic_filtering=True,id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2,network=Network(d0aba411-7d97-41c5-a584-cebaee4503e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab7a46b5-a5')
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrtxEviR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '31b703f3-fb0b-411d-a729-10ea8a57eef5'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:45:32 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[226fd30e-3b92-427d-bb77-81d06fd2fb79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[366dc6bf-1f21-4575-b6d1-1985e75cce7c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:45:32 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:45:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 (non-flash)
Aug 16 16:45:32 user nova-compute[73450]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:45:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2701377f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[665bfdb7-be3d-4200-a62c-eb5a5019df1e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[741868ad-b58f-4d59-9cd0-01696112a763]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d96bf6-c3cc-4cb9-903e-bfd65ff44fd9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04b3c6-98b4-41d1-a123-ea190356c006]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a93a24-05ea-47a3-b4bf-cf1dc90073e1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:45:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cbf7a9-7bb6-424b-9e1f-a550e6421985]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260]
Aug 16 16:45:32 user nova-compute[73450]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5, portal: 172.16.0.220,3260] successful.
Aug 16 16:45:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b703f3-fb0b-411d-a729-10ea8a57eef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[81689d0a-4c13-4159-9e5f-887acf32fefa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] <== disconnect_volume: return (329ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:45:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Deleting instance files /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69_del
Aug 16 16:45:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Deletion of /opt/stack/data/nova/instances/6f285797-8d8a-4b6f-9f39-c79b71124f69_del complete
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.policy [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6ccf870c7044548ffe09751440eff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2304f2dbd95141d49fcca835b05f3829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:45:32 user nova-compute[73450]: INFO nova.compute.manager [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:45:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Creating image(s)
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk 1073741824" returned: 0 in 0.106s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Successfully created port: 7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Cannot resize image /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'migration_context' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Ensure instance console log exists: /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-ca252547-7408-480b-ab99-4df0f9a98111 req-c78d737c-b32f-4f2f-b1a3-5594d32da3d7 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ca252547-7408-480b-ab99-4df0f9a98111 req-c78d737c-b32f-4f2f-b1a3-5594d32da3d7 service nova] Acquiring lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ca252547-7408-480b-ab99-4df0f9a98111 req-c78d737c-b32f-4f2f-b1a3-5594d32da3d7 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ca252547-7408-480b-ab99-4df0f9a98111 req-c78d737c-b32f-4f2f-b1a3-5594d32da3d7 service nova] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-ca252547-7408-480b-ab99-4df0f9a98111 req-c78d737c-b32f-4f2f-b1a3-5594d32da3d7 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] No waiting events found dispatching network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:33 user nova-compute[73450]: WARNING nova.compute.manager [req-ca252547-7408-480b-ab99-4df0f9a98111 req-c78d737c-b32f-4f2f-b1a3-5594d32da3d7 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received unexpected event network-vif-plugged-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 for instance with vm_state active and task_state deleting.
Aug 16 16:45:33 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:34 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Took 1.31 seconds to deallocate network for instance.
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-be713cb4-7eaf-46cf-819a-f8b86a412d82 req-74af9a92-8682-47c7-857a-460782a19aa3 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Received event network-vif-deleted-ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:34 user nova-compute[73450]: INFO nova.compute.manager [req-be713cb4-7eaf-46cf-819a-f8b86a412d82 req-74af9a92-8682-47c7-857a-460782a19aa3 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Neutron deleted interface ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2; detaching it from the instance and deleting it from the info cache
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.network.neutron [req-be713cb4-7eaf-46cf-819a-f8b86a412d82 req-74af9a92-8682-47c7-857a-460782a19aa3 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-be713cb4-7eaf-46cf-819a-f8b86a412d82 req-74af9a92-8682-47c7-857a-460782a19aa3 service nova] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Detach interface failed, port_id=ab7a46b5-a59d-4d98-96ca-94dd48d6e1d2, reason: Instance 6f285797-8d8a-4b6f-9f39-c79b71124f69 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Successfully updated port: 7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing instance network info cache due to event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:45:34 user nova-compute[73450]: INFO nova.compute.manager [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Took 0.84 seconds to detach 1 volumes for instance.
Aug 16 16:45:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance network_info: |[{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Start _get_guest_xml network_info=[{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:45:35 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:45:35 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1187841430',display_name='tempest-ServerStableDeviceRescueTest-server-1187841430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1187841430',id=20,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4/x++wUoGZmru0aCRIEaekAPJ113Jc9WnArIHvJc3ey5w45JjdPec+EH16OHSJYMH1xUS9xeg4BoWRh+aX+sQ48X4gH3th5D0mdpnzZhvyvXYFHyEF1VjknFO445wpOw==',key_name='tempest-keypair-96903892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2304f2dbd95141d49fcca835b05f3829',ramdisk_id='',reservation_id='r-3ljt4t07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-365323873',owner_user_name='tempest-ServerStableDeviceRescueTest-365323873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6ccf870c7044548ffe09751440eff1',uuid=c605c1c9-7033-48a9-8ef8-c1815683bd16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converting VIF {"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.objects.instance [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'pci_devices' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:45:35 user nova-compute[73450]:   <uuid>c605c1c9-7033-48a9-8ef8-c1815683bd16</uuid>
Aug 16 16:45:35 user nova-compute[73450]:   <name>instance-00000014</name>
Aug 16 16:45:35 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:45:35 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:45:35 user nova-compute[73450]:   <metadata>
Aug 16 16:45:35 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:45:35 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:45:35 user nova-compute[73450]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1187841430</nova:name>
Aug 16 16:45:35 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:45:35</nova:creationTime>
Aug 16 16:45:35 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:45:35 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:45:35 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:45:35 user nova-compute[73450]:       <nova:owner>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:user uuid="fc6ccf870c7044548ffe09751440eff1">tempest-ServerStableDeviceRescueTest-365323873-project-member</nova:user>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:project uuid="2304f2dbd95141d49fcca835b05f3829">tempest-ServerStableDeviceRescueTest-365323873</nova:project>
Aug 16 16:45:35 user nova-compute[73450]:       </nova:owner>
Aug 16 16:45:35 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:45:35 user nova-compute[73450]:       <nova:ports>
Aug 16 16:45:35 user nova-compute[73450]:         <nova:port uuid="7fbf4a53-062d-4fc5-990a-fcff33353b26">
Aug 16 16:45:35 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 16:45:35 user nova-compute[73450]:         </nova:port>
Aug 16 16:45:35 user nova-compute[73450]:       </nova:ports>
Aug 16 16:45:35 user nova-compute[73450]:     </nova:instance>
Aug 16 16:45:35 user nova-compute[73450]:   </metadata>
Aug 16 16:45:35 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:45:35 user nova-compute[73450]:     <system>
Aug 16 16:45:35 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:45:35 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:45:35 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:45:35 user nova-compute[73450]:       <entry name="serial">c605c1c9-7033-48a9-8ef8-c1815683bd16</entry>
Aug 16 16:45:35 user nova-compute[73450]:       <entry name="uuid">c605c1c9-7033-48a9-8ef8-c1815683bd16</entry>
Aug 16 16:45:35 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:45:35 user nova-compute[73450]:     </system>
Aug 16 16:45:35 user nova-compute[73450]:   </sysinfo>
Aug 16 16:45:35 user nova-compute[73450]:   <os>
Aug 16 16:45:35 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:45:35 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:45:35 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:45:35 user nova-compute[73450]:   </os>
Aug 16 16:45:35 user nova-compute[73450]:   <features>
Aug 16 16:45:35 user nova-compute[73450]:     <acpi/>
Aug 16 16:45:35 user nova-compute[73450]:     <apic/>
Aug 16 16:45:35 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:45:35 user nova-compute[73450]:   </features>
Aug 16 16:45:35 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:45:35 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:45:35 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:45:35 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:45:35 user nova-compute[73450]:   </clock>
Aug 16 16:45:35 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:45:35 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:45:35 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:45:35 user nova-compute[73450]:   </cpu>
Aug 16 16:45:35 user nova-compute[73450]:   <devices>
Aug 16 16:45:35 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:45:35 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:45:35 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk"/>
Aug 16 16:45:35 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:45:35 user nova-compute[73450]:     </disk>
Aug 16 16:45:35 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:45:35 user nova-compute[73450]:       <mac address="fa:16:3e:57:6a:da"/>
Aug 16 16:45:35 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:45:35 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:45:35 user nova-compute[73450]:       <target dev="tap7fbf4a53-06"/>
Aug 16 16:45:35 user nova-compute[73450]:     </interface>
Aug 16 16:45:35 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:45:35 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/console.log" append="off"/>
Aug 16 16:45:35 user nova-compute[73450]:     </serial>
Aug 16 16:45:35 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:45:35 user nova-compute[73450]:     <video>
Aug 16 16:45:35 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:45:35 user nova-compute[73450]:     </video>
Aug 16 16:45:35 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:45:35 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:45:35 user nova-compute[73450]:     </rng>
Aug 16 16:45:35 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:45:35 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:45:35 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:45:35 user nova-compute[73450]:     </memballoon>
Aug 16 16:45:35 user nova-compute[73450]:   </devices>
Aug 16 16:45:35 user nova-compute[73450]: </domain>
Aug 16 16:45:35 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1187841430',display_name='tempest-ServerStableDeviceRescueTest-server-1187841430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1187841430',id=20,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4/x++wUoGZmru0aCRIEaekAPJ113Jc9WnArIHvJc3ey5w45JjdPec+EH16OHSJYMH1xUS9xeg4BoWRh+aX+sQ48X4gH3th5D0mdpnzZhvyvXYFHyEF1VjknFO445wpOw==',key_name='tempest-keypair-96903892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2304f2dbd95141d49fcca835b05f3829',ramdisk_id='',reservation_id='r-3ljt4t07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-365323873',owner_user_name='tempest-ServerStableDeviceRescueTest-365323873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6ccf870c7044548ffe09751440eff1',uuid=c605c1c9-7033-48a9-8ef8-c1815683bd16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converting VIF {"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG os_vif [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fbf4a53-06, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fbf4a53-06, col_values=(('external_ids', {'iface-id': '7fbf4a53-062d-4fc5-990a-fcff33353b26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:6a:da', 'vm-uuid': 'c605c1c9-7033-48a9-8ef8-c1815683bd16'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:35 user nova-compute[73450]: INFO os_vif [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06')
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No VIF found with MAC fa:16:3e:57:6a:da, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:35 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Deleted allocations for instance 6f285797-8d8a-4b6f-9f39-c79b71124f69
Aug 16 16:45:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1a3543e5-1426-497f-b185-cac7a4fc0c06 tempest-TestVolumeSwap-1170048861 tempest-TestVolumeSwap-1170048861-project-member] Lock "6f285797-8d8a-4b6f-9f39-c79b71124f69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.979s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updated VIF entry in instance network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e3aed0d5-212b-40ea-a65a-d8356b5aac2f req-f3ba1d47-ab26-4c88-b8b8-42070e24ced6 service nova] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-2e932b40-15de-4687-933b-650cb26f0227 req-2733bb89-1634-41f3-9543-4d120521049d service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2e932b40-15de-4687-933b-650cb26f0227 req-2733bb89-1634-41f3-9543-4d120521049d service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2e932b40-15de-4687-933b-650cb26f0227 req-2733bb89-1634-41f3-9543-4d120521049d service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2e932b40-15de-4687-933b-650cb26f0227 req-2733bb89-1634-41f3-9543-4d120521049d service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-2e932b40-15de-4687-933b-650cb26f0227 req-2733bb89-1634-41f3-9543-4d120521049d service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:36 user nova-compute[73450]: WARNING nova.compute.manager [req-2e932b40-15de-4687-933b-650cb26f0227 req-2733bb89-1634-41f3-9543-4d120521049d service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state building and task_state spawning.
Aug 16 16:45:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204338.8318496, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:38 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Resumed (Lifecycle Event)
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:45:38 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance spawned successfully.
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:38 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204338.8332353, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:38 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Started (Lifecycle Event)
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-c4a9df6f-7c0a-43fc-9ab8-e7813d318ccf req-425273e4-3419-4d73-9cf8-631c3f8a81a8 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c4a9df6f-7c0a-43fc-9ab8-e7813d318ccf req-425273e4-3419-4d73-9cf8-631c3f8a81a8 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c4a9df6f-7c0a-43fc-9ab8-e7813d318ccf req-425273e4-3419-4d73-9cf8-631c3f8a81a8 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c4a9df6f-7c0a-43fc-9ab8-e7813d318ccf req-425273e4-3419-4d73-9cf8-631c3f8a81a8 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-c4a9df6f-7c0a-43fc-9ab8-e7813d318ccf req-425273e4-3419-4d73-9cf8-631c3f8a81a8 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:38 user nova-compute[73450]: WARNING nova.compute.manager [req-c4a9df6f-7c0a-43fc-9ab8-e7813d318ccf req-425273e4-3419-4d73-9cf8-631c3f8a81a8 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state building and task_state spawning.
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:45:38 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:45:38 user nova-compute[73450]: INFO nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 16 16:45:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:39 user nova-compute[73450]: INFO nova.compute.manager [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Took 7.13 seconds to build instance.
Aug 16 16:45:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0539ce4f-5f84-49ad-a9ed-1d4966c5fb59 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.249s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:40 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:45:40 user nova-compute[73450]: INFO nova.compute.claims [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Claim successful on node user
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204326.1997988, 42484cde-66d6-4816-962b-912f6df59156 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:41 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 42484cde-66d6-4816-962b-912f6df59156] VM Stopped (Lifecycle Event)
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Skipping network cache update for instance because it is Building. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-83660f6c-77c3-4d12-b251-01f09eb02da7 None None] [instance: 42484cde-66d6-4816-962b-912f6df59156] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid 66f48511-dafc-457b-817e-5bfe039cefa1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.network.neutron [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:45:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:45:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Creating image(s)
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "/opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "/opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "/opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updating instance_info_cache with network_info: [{"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-66f48511-dafc-457b-817e-5bfe039cefa1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk 1073741824" returned: 0 in 0.062s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG nova.policy [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88be8b346f5a4c9bae4ed3f2642bcbc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea8e58c03c24ec7bbdaebc59f173f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Cannot resize image /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lazy-loading 'migration_context' on Instance uuid 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Ensure instance console log exists: /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Successfully created port: b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Successfully updated port: b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "refresh_cache-8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquired lock "refresh_cache-8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-changed-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Refreshing instance network info cache due to event network-changed-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:45:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] Acquiring lock "refresh_cache-8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Updating instance_info_cache with network_info: [{"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Releasing lock "refresh_cache-8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Instance network_info: |[{"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] Acquired lock "refresh_cache-8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.neutron [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Refreshing network info cache for port b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Start _get_guest_xml network_info=[{"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:45:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2114288902',display_name='tempest-VolumesNegativeTest-instance-2114288902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2114288902',id=21,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ea8e58c03c24ec7bbdaebc59f173f8c',ramdisk_id='',reservation_id='r-s6pnzfhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1228748228',owner_user_name='tempest-VolumesNegativeTest-1228748228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:45:42Z,user_data=None,user_id='88be8b346f5a4c9bae4ed3f2642bcbc2',uuid=8581b8bb-99a8-4182-9e1f-781ee0c9e8c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Converting VIF {"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lazy-loading 'pci_devices' on Instance uuid 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:45:44 user nova-compute[73450]:   <uuid>8581b8bb-99a8-4182-9e1f-781ee0c9e8c3</uuid>
Aug 16 16:45:44 user nova-compute[73450]:   <name>instance-00000015</name>
Aug 16 16:45:44 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:45:44 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:45:44 user nova-compute[73450]:   <metadata>
Aug 16 16:45:44 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:45:44 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:45:44 user nova-compute[73450]:       <nova:name>tempest-VolumesNegativeTest-instance-2114288902</nova:name>
Aug 16 16:45:44 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:45:44</nova:creationTime>
Aug 16 16:45:44 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:45:44 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:45:44 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:45:44 user nova-compute[73450]:       <nova:owner>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:user uuid="88be8b346f5a4c9bae4ed3f2642bcbc2">tempest-VolumesNegativeTest-1228748228-project-member</nova:user>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:project uuid="5ea8e58c03c24ec7bbdaebc59f173f8c">tempest-VolumesNegativeTest-1228748228</nova:project>
Aug 16 16:45:44 user nova-compute[73450]:       </nova:owner>
Aug 16 16:45:44 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:45:44 user nova-compute[73450]:       <nova:ports>
Aug 16 16:45:44 user nova-compute[73450]:         <nova:port uuid="b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db">
Aug 16 16:45:44 user nova-compute[73450]:           <nova:ip type="fixed" address="192.168.233.148" ipVersion="4"/>
Aug 16 16:45:44 user nova-compute[73450]:         </nova:port>
Aug 16 16:45:44 user nova-compute[73450]:       </nova:ports>
Aug 16 16:45:44 user nova-compute[73450]:     </nova:instance>
Aug 16 16:45:44 user nova-compute[73450]:   </metadata>
Aug 16 16:45:44 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:45:44 user nova-compute[73450]:     <system>
Aug 16 16:45:44 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:45:44 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:45:44 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:45:44 user nova-compute[73450]:       <entry name="serial">8581b8bb-99a8-4182-9e1f-781ee0c9e8c3</entry>
Aug 16 16:45:44 user nova-compute[73450]:       <entry name="uuid">8581b8bb-99a8-4182-9e1f-781ee0c9e8c3</entry>
Aug 16 16:45:44 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:45:44 user nova-compute[73450]:     </system>
Aug 16 16:45:44 user nova-compute[73450]:   </sysinfo>
Aug 16 16:45:44 user nova-compute[73450]:   <os>
Aug 16 16:45:44 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:45:44 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:45:44 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:45:44 user nova-compute[73450]:   </os>
Aug 16 16:45:44 user nova-compute[73450]:   <features>
Aug 16 16:45:44 user nova-compute[73450]:     <acpi/>
Aug 16 16:45:44 user nova-compute[73450]:     <apic/>
Aug 16 16:45:44 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:45:44 user nova-compute[73450]:   </features>
Aug 16 16:45:44 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:45:44 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:45:44 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:45:44 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:45:44 user nova-compute[73450]:   </clock>
Aug 16 16:45:44 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:45:44 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:45:44 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:45:44 user nova-compute[73450]:   </cpu>
Aug 16 16:45:44 user nova-compute[73450]:   <devices>
Aug 16 16:45:44 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:45:44 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:45:44 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk"/>
Aug 16 16:45:44 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:45:44 user nova-compute[73450]:     </disk>
Aug 16 16:45:44 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:45:44 user nova-compute[73450]:       <mac address="fa:16:3e:a0:9a:b9"/>
Aug 16 16:45:44 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:45:44 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:45:44 user nova-compute[73450]:       <target dev="tapb170b2c1-66"/>
Aug 16 16:45:44 user nova-compute[73450]:     </interface>
Aug 16 16:45:44 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:45:44 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/console.log" append="off"/>
Aug 16 16:45:44 user nova-compute[73450]:     </serial>
Aug 16 16:45:44 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:45:44 user nova-compute[73450]:     <video>
Aug 16 16:45:44 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:45:44 user nova-compute[73450]:     </video>
Aug 16 16:45:44 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:45:44 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:45:44 user nova-compute[73450]:     </rng>
Aug 16 16:45:44 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:45:44 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:45:44 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:45:44 user nova-compute[73450]:     </memballoon>
Aug 16 16:45:44 user nova-compute[73450]:   </devices>
Aug 16 16:45:44 user nova-compute[73450]: </domain>
Aug 16 16:45:44 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2114288902',display_name='tempest-VolumesNegativeTest-instance-2114288902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2114288902',id=21,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ea8e58c03c24ec7bbdaebc59f173f8c',ramdisk_id='',reservation_id='r-s6pnzfhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1228748228',owner_user_name='tempest-VolumesNegativeTest-1228748228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:45:42Z,user_data=None,user_id='88be8b346f5a4c9bae4ed3f2642bcbc2',uuid=8581b8bb-99a8-4182-9e1f-781ee0c9e8c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Converting VIF {"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG os_vif [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb170b2c1-66, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb170b2c1-66, col_values=(('external_ids', {'iface-id': 'b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:9a:b9', 'vm-uuid': '8581b8bb-99a8-4182-9e1f-781ee0c9e8c3'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:44 user nova-compute[73450]: INFO os_vif [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66')
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] No VIF found with MAC fa:16:3e:a0:9a:b9, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Updated VIF entry in instance network info cache for port b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Updating instance_info_cache with network_info: [{"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-22a2938e-63d9-415d-a112-fde05dc2179c req-6d4833ba-223f-48e0-be17-42f50550365f service nova] Releasing lock "refresh_cache-8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa84870e-fa0a-460f-97d8-96d284d2900a req-fc7599fb-462f-4cd5-9d79-b70955223723 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa84870e-fa0a-460f-97d8-96d284d2900a req-fc7599fb-462f-4cd5-9d79-b70955223723 service nova] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa84870e-fa0a-460f-97d8-96d284d2900a req-fc7599fb-462f-4cd5-9d79-b70955223723 service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa84870e-fa0a-460f-97d8-96d284d2900a req-fc7599fb-462f-4cd5-9d79-b70955223723 service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa84870e-fa0a-460f-97d8-96d284d2900a req-fc7599fb-462f-4cd5-9d79-b70955223723 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] No waiting events found dispatching network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:46 user nova-compute[73450]: WARNING nova.compute.manager [req-aa84870e-fa0a-460f-97d8-96d284d2900a req-fc7599fb-462f-4cd5-9d79-b70955223723 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received unexpected event network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db for instance with vm_state building and task_state spawning.
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:47 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204332.21906, 6f285797-8d8a-4b6f-9f39-c79b71124f69 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:47 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] VM Stopped (Lifecycle Event)
Aug 16 16:45:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c5b7cb02-14eb-4f94-b2bf-3ddd9403b72f None None] [instance: 6f285797-8d8a-4b6f-9f39-c79b71124f69] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204348.375238, 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] VM Resumed (Lifecycle Event)
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-f02b8526-023d-4937-8e44-2a7f86655376 req-eab319b0-af11-434e-b55e-1cd4e3b5ec00 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f02b8526-023d-4937-8e44-2a7f86655376 req-eab319b0-af11-434e-b55e-1cd4e3b5ec00 service nova] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f02b8526-023d-4937-8e44-2a7f86655376 req-eab319b0-af11-434e-b55e-1cd4e3b5ec00 service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f02b8526-023d-4937-8e44-2a7f86655376 req-eab319b0-af11-434e-b55e-1cd4e3b5ec00 service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-f02b8526-023d-4937-8e44-2a7f86655376 req-eab319b0-af11-434e-b55e-1cd4e3b5ec00 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] No waiting events found dispatching network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:45:48 user nova-compute[73450]: WARNING nova.compute.manager [req-f02b8526-023d-4937-8e44-2a7f86655376 req-eab319b0-af11-434e-b55e-1cd4e3b5ec00 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received unexpected event network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db for instance with vm_state building and task_state spawning.
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:48 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:45:48 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=24.182708740234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Instance spawned successfully.
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204348.3765733, 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] VM Started (Lifecycle Event)
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-changed-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Refreshing instance network info cache due to event network-changed-66e95def-8bb9-4a6c-9dfe-b286396ac0b6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] Acquiring lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] Acquired lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Refreshing network info cache for port 66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance ada60a07-c8f4-4dd6-a68e-a46121493bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 93e6b212-411d-408e-94a2-37a64232f8e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:45:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:45:48 user nova-compute[73450]: INFO nova.compute.manager [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Took 8.02 seconds to build instance.
Aug 16 16:45:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-dc3974d5-b76a-4f96-90f2-2ea4de31c3c7 tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.135s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updated VIF entry in instance network info cache for port 66e95def-8bb9-4a6c-9dfe-b286396ac0b6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updating instance_info_cache with network_info: [{"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-853e34c2-992e-44ad-8dbe-4682a6f0da29 req-cc501dcc-de2c-4c15-bbbf-022a206ae7f1 service nova] Releasing lock "refresh_cache-ada60a07-c8f4-4dd6-a68e-a46121493bce" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:45:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:45:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lazy-loading 'flavor' on Instance uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:45:53 user nova-compute[73450]: INFO nova.compute.manager [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Attaching volume 12316dbc-2e99-418a-b2b0-b8b09b01bf8c to /dev/sdc
Aug 16 16:45:53 user nova-compute[73450]: DEBUG os_brick.utils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6345e24e-d1ca-4668-ab73-407b3e505ae4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09b3fde-ebef-4919-80d7-6f7f7401d767]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f74ec-f773-49c1-b911-4ee45a03cd9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6672edd9-3aec-415c-a4be-dbc223e04b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:45:53 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:45:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a9638-d5b6-4839-932d-db1d7cfe8d49]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG os_brick.utils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:45:53 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updating existing volume attachment record: 1d14dab8-b2b7-4e35-b608-0f6845ab2af8 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:45:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-changed-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Refreshing instance network info cache due to event network-changed-77f40a61-d7ad-4a05-81bc-c24b58ba65f6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:45:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Refreshing network info cache for port 77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:46:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updated VIF entry in instance network info cache for port 77f40a61-d7ad-4a05-81bc-c24b58ba65f6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:46:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c1987e8-8a96-4ba3-981e-57c6720f78de req-ab1d4d0b-6a2a-4e29-b961-00c32537718a service nova] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHCXdTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:46:04 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:46:04 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:46:04 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:46:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d3b41-4099-437a-965d-60fcd0ce8a8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:46:04 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41e049b-311a-4566-9f5f-1d59327d587e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c] added
Aug 16 16:46:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba7b6d-458a-4674-b421-77fdadd6b1bd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0d091a-54d7-4914-9227-3f652b67dda8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRHCXdTL {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRHCXdTL" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb695d9a-9900-4007-95f0-5c716b67d5bf]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRHCXdTL'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a8e92-294f-499b-82e7-112a12e69e84]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[902c7c2b-c205-4b83-86ac-823062c54df2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:46:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:46:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60091a6-67aa-4fd5-984c-3c5228b6e403]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260]
Aug 16 16:46:04 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260] successful.
Aug 16 16:46:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fcc808-1d47-4743-866e-0befde4a5e60]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0cbfc-f4e1-4032-bb3a-b146bf4d37be]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:46:04 user nova-compute[73450]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c (non-flash)
Aug 16 16:46:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:46:04 user nova-compute[73450]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c (non-flash)
Aug 16 16:46:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9f3c5-4d46-4fe8-a57c-2931b452eb0a]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHCXdTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23531623664306537', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531623664306537', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lazy-loading 'flavor' on Instance uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:46:05 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:46:05 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:46:05 user nova-compute[73450]:   <target dev="sdc" bus="scsi"/>
Aug 16 16:46:05 user nova-compute[73450]:   <serial>12316dbc-2e99-418a-b2b0-b8b09b01bf8c</serial>
Aug 16 16:46:05 user nova-compute[73450]:   <address type="drive" controller="0" unit="2"/>
Aug 16 16:46:05 user nova-compute[73450]: </disk>
Aug 16 16:46:05 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:46:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No BDM found with device name sda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:46:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:46:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:46:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] No VIF found with MAC fa:16:3e:77:22:82, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:46:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c49d5d8e-313a-489c-85b2-b712aff271a9 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.810s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:07 user nova-compute[73450]: INFO nova.compute.manager [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Detaching volume 12316dbc-2e99-418a-b2b0-b8b09b01bf8c
Aug 16 16:46:08 user nova-compute[73450]: INFO nova.virt.block_device [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Attempting to driver detach volume 12316dbc-2e99-418a-b2b0-b8b09b01bf8c from mountpoint /dev/sdc
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Attempting to detach device sdc from instance ada60a07-c8f4-4dd6-a68e-a46121493bce from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:46:08 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:46:08 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:46:08 user nova-compute[73450]:   <target dev="sdc" bus="scsi"/>
Aug 16 16:46:08 user nova-compute[73450]:   <serial>12316dbc-2e99-418a-b2b0-b8b09b01bf8c</serial>
Aug 16 16:46:08 user nova-compute[73450]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 16:46:08 user nova-compute[73450]: </disk>
Aug 16 16:46:08 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:46:08 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Successfully detached device sdc from instance ada60a07-c8f4-4dd6-a68e-a46121493bce from the persistent domain config.
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ada60a07-c8f4-4dd6-a68e-a46121493bce from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:46:08 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:46:08 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:46:08 user nova-compute[73450]:   <target dev="sdc" bus="scsi"/>
Aug 16 16:46:08 user nova-compute[73450]:   <serial>12316dbc-2e99-418a-b2b0-b8b09b01bf8c</serial>
Aug 16 16:46:08 user nova-compute[73450]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 16:46:08 user nova-compute[73450]: </disk>
Aug 16 16:46:08 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204368.4654229, ada60a07-c8f4-4dd6-a68e-a46121493bce => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:46:08 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Successfully detached device sdc from instance ada60a07-c8f4-4dd6-a68e-a46121493bce from the live domain config.
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHCXdTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:46:08 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8774c2f3-c4aa-46dd-b39c-998befd9978b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9690f9-5af4-4871-9674-adbbfe2d1dc6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:46:08 user nova-compute[73450]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c (non-flash)
Aug 16 16:46:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:46:08 user nova-compute[73450]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c (non-flash)
Aug 16 16:46:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe282207ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[723ff98f-7229-4245-b6eb-81805e30eb11]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7381b53a-3352-482b-81c1-1465b7ac4798]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7cbcd0-5763-411d-8778-dfd396baa726]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4652a272-6625-4568-b982-3109089124f1]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aae97c-54f9-46a7-8749-327a50d2487d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ed43a-b5d4-44bf-838b-3dd2de809b1a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260]
Aug 16 16:46:08 user nova-compute[73450]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c, portal: 172.16.0.220,3260] successful.
Aug 16 16:46:08 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12316dbc-2e99-418a-b2b0-b8b09b01bf8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b70407-e578-4a52-8521-440fbfb7a1dd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] <== disconnect_volume: return (303ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:46:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:46:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:09 user nova-compute[73450]: DEBUG nova.objects.instance [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lazy-loading 'flavor' on Instance uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e3258bd9-96fd-40e8-aad8-d20447558384 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.700s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Terminating instance
Aug 16 16:46:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-352940de-ebce-408b-98b3-92715c9c9b5b req-900e6eab-cdd6-46eb-bfed-dc88bc7cc224 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-vif-unplugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-352940de-ebce-408b-98b3-92715c9c9b5b req-900e6eab-cdd6-46eb-bfed-dc88bc7cc224 service nova] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-352940de-ebce-408b-98b3-92715c9c9b5b req-900e6eab-cdd6-46eb-bfed-dc88bc7cc224 service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-352940de-ebce-408b-98b3-92715c9c9b5b req-900e6eab-cdd6-46eb-bfed-dc88bc7cc224 service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-352940de-ebce-408b-98b3-92715c9c9b5b req-900e6eab-cdd6-46eb-bfed-dc88bc7cc224 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] No waiting events found dispatching network-vif-unplugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-352940de-ebce-408b-98b3-92715c9c9b5b req-900e6eab-cdd6-46eb-bfed-dc88bc7cc224 service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-vif-unplugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:46:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Instance destroyed successfully.
Aug 16 16:46:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lazy-loading 'resources' on Instance uuid ada60a07-c8f4-4dd6-a68e-a46121493bce {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T16:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1626750148',display_name='tempest-AttachSCSIVolumeTestJSON-server-1626750148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1626750148',id=17,image_ref='8bc92e85-3a6a-4d45-8fa5-255660713803',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWKA9EIiific0Lia5boRlyyz9WatmQknC4Qzr+5pTX9XaT5R+RYYa4wNHcvI9z+kxqmUwpEVjA0WbnBPUc/GakzXii6n6xNlR0fxbDfNkedV/HfkbgnIOKxjrM2wBC+LQ==',key_name='tempest-keypair-851990394',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:44:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98a752b1016e433f8615898e0dbcfe55',ramdisk_id='',reservation_id='r-3tw5ifeg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8bc92e85-3a6a-4d45-8fa5-255660713803',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1791956531',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1791956531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='046d6f165b1d433d811270235272d9c3',uuid=ada60a07-c8f4-4dd6-a68e-a46121493bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Converting VIF {"id": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "address": "fa:16:3e:77:22:82", "network": {"id": "a0876536-788c-46ef-8155-1a908b7ee796", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1023006540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98a752b1016e433f8615898e0dbcfe55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66e95def-8b", "ovs_interfaceid": "66e95def-8bb9-4a6c-9dfe-b286396ac0b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG os_vif [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66e95def-8b, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:46:11 user nova-compute[73450]: INFO os_vif [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:22:82,bridge_name='br-int',has_traffic_filtering=True,id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6,network=Network(a0876536-788c-46ef-8155-1a908b7ee796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66e95def-8b')
Aug 16 16:46:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Deleting instance files /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce_del
Aug 16 16:46:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Deletion of /opt/stack/data/nova/instances/ada60a07-c8f4-4dd6-a68e-a46121493bce_del complete
Aug 16 16:46:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 16:46:11 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:46:11 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-ce3bb659-99f2-47cf-b39a-c3fd37c85e65 req-6fa93bdb-de9d-43b3-a182-9d2455ba595e service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-vif-deleted-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:12 user nova-compute[73450]: INFO nova.compute.manager [req-ce3bb659-99f2-47cf-b39a-c3fd37c85e65 req-6fa93bdb-de9d-43b3-a182-9d2455ba595e service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Neutron deleted interface 66e95def-8bb9-4a6c-9dfe-b286396ac0b6; detaching it from the instance and deleting it from the info cache
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.network.neutron [req-ce3bb659-99f2-47cf-b39a-c3fd37c85e65 req-6fa93bdb-de9d-43b3-a182-9d2455ba595e service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:12 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Took 1.10 seconds to deallocate network for instance.
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-ce3bb659-99f2-47cf-b39a-c3fd37c85e65 req-6fa93bdb-de9d-43b3-a182-9d2455ba595e service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Detach interface failed, port_id=66e95def-8bb9-4a6c-9dfe-b286396ac0b6, reason: Instance ada60a07-c8f4-4dd6-a68e-a46121493bce could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-48b5ae00-b2c7-4d36-b860-0a4dc9093fb4 req-1a3117a4-af07-4eb9-99d2-ddcec636c29f service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received event network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-48b5ae00-b2c7-4d36-b860-0a4dc9093fb4 req-1a3117a4-af07-4eb9-99d2-ddcec636c29f service nova] Acquiring lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-48b5ae00-b2c7-4d36-b860-0a4dc9093fb4 req-1a3117a4-af07-4eb9-99d2-ddcec636c29f service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-48b5ae00-b2c7-4d36-b860-0a4dc9093fb4 req-1a3117a4-af07-4eb9-99d2-ddcec636c29f service nova] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-48b5ae00-b2c7-4d36-b860-0a4dc9093fb4 req-1a3117a4-af07-4eb9-99d2-ddcec636c29f service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] No waiting events found dispatching network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:12 user nova-compute[73450]: WARNING nova.compute.manager [req-48b5ae00-b2c7-4d36-b860-0a4dc9093fb4 req-1a3117a4-af07-4eb9-99d2-ddcec636c29f service nova] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Received unexpected event network-vif-plugged-66e95def-8bb9-4a6c-9dfe-b286396ac0b6 for instance with vm_state deleted and task_state None.
Aug 16 16:46:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:12 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Deleted allocations for instance ada60a07-c8f4-4dd6-a68e-a46121493bce
Aug 16 16:46:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-da5eea64-c99d-4a19-82d1-9fe21da47e76 tempest-AttachSCSIVolumeTestJSON-1791956531 tempest-AttachSCSIVolumeTestJSON-1791956531-project-member] Lock "ada60a07-c8f4-4dd6-a68e-a46121493bce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.602s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:26 user nova-compute[73450]: INFO nova.compute.manager [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Unrescuing
Aug 16 16:46:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204371.2993915, ada60a07-c8f4-4dd6-a68e-a46121493bce => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:46:26 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] VM Stopped (Lifecycle Event)
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6bc0b78d-8cf1-45e6-8304-12f5cab65d59 None None] [instance: ada60a07-c8f4-4dd6-a68e-a46121493bce] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'flavor' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-219577d9-b7ea-40af-bf16-4343d7591095 req-20d85082-958f-4f65-abee-9784a8f41595 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-219577d9-b7ea-40af-bf16-4343d7591095 req-20d85082-958f-4f65-abee-9784a8f41595 service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-219577d9-b7ea-40af-bf16-4343d7591095 req-20d85082-958f-4f65-abee-9784a8f41595 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-219577d9-b7ea-40af-bf16-4343d7591095 req-20d85082-958f-4f65-abee-9784a8f41595 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-219577d9-b7ea-40af-bf16-4343d7591095 req-20d85082-958f-4f65-abee-9784a8f41595 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:26 user nova-compute[73450]: WARNING nova.compute.manager [req-219577d9-b7ea-40af-bf16-4343d7591095 req-20d85082-958f-4f65-abee-9784a8f41595 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:46:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance destroyed successfully.
Aug 16 16:46:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-79012421-815b-4aac-8bde-2b8b64f22934 req-bb88962a-0c18-47b6-90a2-dee71dad8574 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-79012421-815b-4aac-8bde-2b8b64f22934 req-bb88962a-0c18-47b6-90a2-dee71dad8574 service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-79012421-815b-4aac-8bde-2b8b64f22934 req-bb88962a-0c18-47b6-90a2-dee71dad8574 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-79012421-815b-4aac-8bde-2b8b64f22934 req-bb88962a-0c18-47b6-90a2-dee71dad8574 service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-79012421-815b-4aac-8bde-2b8b64f22934 req-bb88962a-0c18-47b6-90a2-dee71dad8574 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:29 user nova-compute[73450]: WARNING nova.compute.manager [req-79012421-815b-4aac-8bde-2b8b64f22934 req-bb88962a-0c18-47b6-90a2-dee71dad8574 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:46:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:31 user nova-compute[73450]: WARNING nova.compute.manager [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:31 user nova-compute[73450]: WARNING nova.compute.manager [req-ddd21045-14fc-4857-986c-ba7be6f4f879 req-2110deb4-c101-49f5-b10c-5feb2d5019ae service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 78128529-664d-4e24-9a7b-a242e67a2ddf due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204391.1639943, 78128529-664d-4e24-9a7b-a242e67a2ddf => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:46:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Resumed (Lifecycle Event)
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-816269bc-760b-4b81-9361-b53646f09a4d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:46:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204391.1644218, 78128529-664d-4e24-9a7b-a242e67a2ddf => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:46:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Started (Lifecycle Event)
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:46:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:46:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:46:35 user nova-compute[73450]: INFO nova.compute.claims [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Claim successful on node user
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.network.neutron [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:46:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.policy [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba47a29f14cc441e826c9af67f20c96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1acac15e03f4d6188cb3517a7901da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:46:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Creating image(s)
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk 1073741824" returned: 0 in 0.052s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG nova.objects.instance [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'migration_context' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Ensure instance console log exists: /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Successfully created port: 4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Successfully updated port: 4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquired lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-changed-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Refreshing instance network info cache due to event network-changed-4a62f6e8-e050-4dae-90ee-7b0724310e90. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] Acquiring lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating instance_info_cache with network_info: [{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Releasing lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance network_info: |[{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] Acquired lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Refreshing network info cache for port 4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start _get_guest_xml network_info=[{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:46:38 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:46:38 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:46:38 user nova-compute[73450]:   <uuid>b1ab59d8-8633-4be5-9fa5-d74e7c34df66</uuid>
Aug 16 16:46:38 user nova-compute[73450]:   <name>instance-00000016</name>
Aug 16 16:46:38 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:46:38 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:46:38 user nova-compute[73450]:   <metadata>
Aug 16 16:46:38 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:46:38 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:46:38 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeTestJSON-server-1851611719</nova:name>
Aug 16 16:46:38 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:46:38</nova:creationTime>
Aug 16 16:46:38 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:46:38 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:46:38 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:46:38 user nova-compute[73450]:       <nova:owner>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:user uuid="ba47a29f14cc441e826c9af67f20c96a">tempest-AttachVolumeTestJSON-570659826-project-member</nova:user>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:project uuid="d1acac15e03f4d6188cb3517a7901da4">tempest-AttachVolumeTestJSON-570659826</nova:project>
Aug 16 16:46:38 user nova-compute[73450]:       </nova:owner>
Aug 16 16:46:38 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:46:38 user nova-compute[73450]:       <nova:ports>
Aug 16 16:46:38 user nova-compute[73450]:         <nova:port uuid="4a62f6e8-e050-4dae-90ee-7b0724310e90">
Aug 16 16:46:38 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:46:38 user nova-compute[73450]:         </nova:port>
Aug 16 16:46:38 user nova-compute[73450]:       </nova:ports>
Aug 16 16:46:38 user nova-compute[73450]:     </nova:instance>
Aug 16 16:46:38 user nova-compute[73450]:   </metadata>
Aug 16 16:46:38 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:46:38 user nova-compute[73450]:     <system>
Aug 16 16:46:38 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:46:38 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:46:38 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:46:38 user nova-compute[73450]:       <entry name="serial">b1ab59d8-8633-4be5-9fa5-d74e7c34df66</entry>
Aug 16 16:46:38 user nova-compute[73450]:       <entry name="uuid">b1ab59d8-8633-4be5-9fa5-d74e7c34df66</entry>
Aug 16 16:46:38 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:46:38 user nova-compute[73450]:     </system>
Aug 16 16:46:38 user nova-compute[73450]:   </sysinfo>
Aug 16 16:46:38 user nova-compute[73450]:   <os>
Aug 16 16:46:38 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:46:38 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:46:38 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:46:38 user nova-compute[73450]:   </os>
Aug 16 16:46:38 user nova-compute[73450]:   <features>
Aug 16 16:46:38 user nova-compute[73450]:     <acpi/>
Aug 16 16:46:38 user nova-compute[73450]:     <apic/>
Aug 16 16:46:38 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:46:38 user nova-compute[73450]:   </features>
Aug 16 16:46:38 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:46:38 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:46:38 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:46:38 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:46:38 user nova-compute[73450]:   </clock>
Aug 16 16:46:38 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:46:38 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:46:38 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:46:38 user nova-compute[73450]:   </cpu>
Aug 16 16:46:38 user nova-compute[73450]:   <devices>
Aug 16 16:46:38 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:46:38 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:46:38 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk"/>
Aug 16 16:46:38 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:46:38 user nova-compute[73450]:     </disk>
Aug 16 16:46:38 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:46:38 user nova-compute[73450]:       <mac address="fa:16:3e:64:3d:a7"/>
Aug 16 16:46:38 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:46:38 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:46:38 user nova-compute[73450]:       <target dev="tap4a62f6e8-e0"/>
Aug 16 16:46:38 user nova-compute[73450]:     </interface>
Aug 16 16:46:38 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:46:38 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/console.log" append="off"/>
Aug 16 16:46:38 user nova-compute[73450]:     </serial>
Aug 16 16:46:38 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:46:38 user nova-compute[73450]:     <video>
Aug 16 16:46:38 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:46:38 user nova-compute[73450]:     </video>
Aug 16 16:46:38 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:46:38 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:46:38 user nova-compute[73450]:     </rng>
Aug 16 16:46:38 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:46:38 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:46:38 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:46:38 user nova-compute[73450]:     </memballoon>
Aug 16 16:46:38 user nova-compute[73450]:   </devices>
Aug 16 16:46:38 user nova-compute[73450]: </domain>
Aug 16 16:46:38 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG os_vif [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a62f6e8-e0, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a62f6e8-e0, col_values=(('external_ids', {'iface-id': '4a62f6e8-e050-4dae-90ee-7b0724310e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:3d:a7', 'vm-uuid': 'b1ab59d8-8633-4be5-9fa5-d74e7c34df66'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:38 user nova-compute[73450]: INFO os_vif [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0')
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:46:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No VIF found with MAC fa:16:3e:64:3d:a7, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:46:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updated VIF entry in instance network info cache for port 4a62f6e8-e050-4dae-90ee-7b0724310e90. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:46:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating instance_info_cache with network_info: [{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9afcb8c5-8b17-47e1-86b1-82b5ba67aa00 req-2af23e60-37b3-4746-867e-c2d1c80e3977 service nova] Releasing lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-66861474-8fb0-4ddf-851b-f0197340965b req-c2328ece-300b-4298-815c-9d90991bb94e service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-66861474-8fb0-4ddf-851b-f0197340965b req-c2328ece-300b-4298-815c-9d90991bb94e service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-66861474-8fb0-4ddf-851b-f0197340965b req-c2328ece-300b-4298-815c-9d90991bb94e service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-66861474-8fb0-4ddf-851b-f0197340965b req-c2328ece-300b-4298-815c-9d90991bb94e service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-66861474-8fb0-4ddf-851b-f0197340965b req-c2328ece-300b-4298-815c-9d90991bb94e service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:40 user nova-compute[73450]: WARNING nova.compute.manager [req-66861474-8fb0-4ddf-851b-f0197340965b req-c2328ece-300b-4298-815c-9d90991bb94e service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state building and task_state spawning.
Aug 16 16:46:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204402.4608765, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Resumed (Lifecycle Event)
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance spawned successfully.
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204402.4647095, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Started (Lifecycle Event)
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:42 user nova-compute[73450]: INFO nova.compute.manager [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Took 6.77 seconds to build instance.
Aug 16 16:46:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-00fecf0d-49bb-4f7f-8289-68d907729c41 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.878s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a24ac39e-1c45-4b6a-8a3a-2fb7f611b642 req-114dd239-cca6-4587-98a6-d7151b44de5f service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a24ac39e-1c45-4b6a-8a3a-2fb7f611b642 req-114dd239-cca6-4587-98a6-d7151b44de5f service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a24ac39e-1c45-4b6a-8a3a-2fb7f611b642 req-114dd239-cca6-4587-98a6-d7151b44de5f service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a24ac39e-1c45-4b6a-8a3a-2fb7f611b642 req-114dd239-cca6-4587-98a6-d7151b44de5f service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a24ac39e-1c45-4b6a-8a3a-2fb7f611b642 req-114dd239-cca6-4587-98a6-d7151b44de5f service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:42 user nova-compute[73450]: WARNING nova.compute.manager [req-a24ac39e-1c45-4b6a-8a3a-2fb7f611b642 req-114dd239-cca6-4587-98a6-d7151b44de5f service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state active and task_state None.
Aug 16 16:46:43 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updating instance_info_cache with network_info: [{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:46:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing instance network info cache due to event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updated VIF entry in instance network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0011d026-e455-4f50-af6f-9767f61a7a66 req-5086de26-49a9-4ef5-8cdb-e4bcdca758e8 service nova] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:49 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:46:49 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7349MB free_disk=24.14275360107422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 66f48511-dafc-457b-817e-5bfe039cefa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 93e6b212-411d-408e-94a2-37a64232f8e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:46:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:51 user nova-compute[73450]: INFO nova.compute.manager [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Shelving
Aug 16 16:46:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-b710c01a-b895-40ee-a494-fdcb75c3103e req-586bdc8f-3a1b-4019-b806-4c46d379356d service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-unplugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b710c01a-b895-40ee-a494-fdcb75c3103e req-586bdc8f-3a1b-4019-b806-4c46d379356d service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b710c01a-b895-40ee-a494-fdcb75c3103e req-586bdc8f-3a1b-4019-b806-4c46d379356d service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b710c01a-b895-40ee-a494-fdcb75c3103e req-586bdc8f-3a1b-4019-b806-4c46d379356d service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-b710c01a-b895-40ee-a494-fdcb75c3103e req-586bdc8f-3a1b-4019-b806-4c46d379356d service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-unplugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:51 user nova-compute[73450]: WARNING nova.compute.manager [req-b710c01a-b895-40ee-a494-fdcb75c3103e req-586bdc8f-3a1b-4019-b806-4c46d379356d service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-unplugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state active and task_state shelving.
Aug 16 16:46:51 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance destroyed successfully.
Aug 16 16:46:51 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Beginning cold snapshot process
Aug 16 16:46:52 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:46:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk /opt/stack/data/nova/instances/snapshots/tmpy4jwbbz9/e17d5190e11340ddad7b78069a83fd29 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:46:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk /opt/stack/data/nova/instances/snapshots/tmpy4jwbbz9/e17d5190e11340ddad7b78069a83fd29" returned: 0 in 0.456s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:46:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Snapshot extracted, beginning image upload
Aug 16 16:46:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-f70053d9-a318-49c5-b5ec-e7dda4eaad30 req-c541b240-0c9c-450f-8c51-78af5bb43c2e service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f70053d9-a318-49c5-b5ec-e7dda4eaad30 req-c541b240-0c9c-450f-8c51-78af5bb43c2e service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f70053d9-a318-49c5-b5ec-e7dda4eaad30 req-c541b240-0c9c-450f-8c51-78af5bb43c2e service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f70053d9-a318-49c5-b5ec-e7dda4eaad30 req-c541b240-0c9c-450f-8c51-78af5bb43c2e service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-f70053d9-a318-49c5-b5ec-e7dda4eaad30 req-c541b240-0c9c-450f-8c51-78af5bb43c2e service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:46:53 user nova-compute[73450]: WARNING nova.compute.manager [req-f70053d9-a318-49c5-b5ec-e7dda4eaad30 req-c541b240-0c9c-450f-8c51-78af5bb43c2e service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 16:46:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:55 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Snapshot image upload complete
Aug 16 16:46:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:55 user nova-compute[73450]: INFO nova.compute.manager [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Shelve offloading
Aug 16 16:46:55 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance destroyed successfully.
Aug 16 16:46:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:46:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:46:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance destroyed successfully.
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'resources' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing instance network info cache due to event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018494408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018494408',id=19,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi0AjEzjAp0y9wC6wtaJb6A8GOtK4WEmiGjVIByW/okJacDOnQ3MnbPq65C/qNlF+LYqmS/3wwM7Uix6eMtBwtBkeuHUCNQ9gnSimuX4aG+LYX5HeONxRsFiKnu2L6aZw==',key_name='tempest-keypair-1720053238',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-5dj8p0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member',shelved_at='2023-08-16T16:46:55.196364',shelved_host='user',shelved_image_id='7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=93e6b212-411d-408e-94a2-37a64232f8e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG os_vif [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1b77572-0f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:46:56 user nova-compute[73450]: INFO os_vif [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f')
Aug 16 16:46:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Deleting instance files /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5_del
Aug 16 16:46:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Deletion of /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5_del complete
Aug 16 16:46:56 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Deleted allocations for instance 93e6b212-411d-408e-94a2-37a64232f8e5
Aug 16 16:46:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'numa_topology' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updated VIF entry in instance network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc1b77572-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7184f175-1d3e-4cdb-8ba9-f4cf00f7da8a req-f1e7cf17-b462-49a7-b8b5-1f9ff6ce6e6c service nova] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:46:56 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:46:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19017042-541c-4a0c-9b4d-e81b26358cce tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.990s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:46:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:04 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:47:04 user nova-compute[73450]: INFO nova.compute.claims [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Claim successful on node user
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:47:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.policy [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb44f7411ad47b18d2c58a1dc6ac074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db72f2fe40fe410098164a19683782d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:47:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Creating image(s)
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.207s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk 1073741824" returned: 0 in 0.067s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Cannot resize image /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.objects.instance [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'migration_context' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Successfully created port: 584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Ensure instance console log exists: /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204411.8964694, 93e6b212-411d-408e-94a2-37a64232f8e5 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:06 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] VM Stopped (Lifecycle Event)
Aug 16 16:47:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-017184e3-67ba-4d8f-9a8a-67bdb8f3d19a None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Successfully updated port: 584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-changed-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Refreshing instance network info cache due to event network-changed-584b7d85-9923-49f7-96df-27900e697677. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] Acquiring lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updating instance_info_cache with network_info: [{"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance network_info: |[{"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] Acquired lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Refreshing network info cache for port 584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Start _get_guest_xml network_info=[{"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:47:07 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:47:07 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2063771279',display_name='tempest-tempest.common.compute-instance-2063771279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2063771279',id=23,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQmCjEwBWBT/s+RkkCOjc/eGOP9z0w95KzLeTdPqlgCuTZqJVaN5DjiHNfWqPwKgKEuD9tdNOXK1xjbGitp8WqrUfrXMvUumz62835vCPBQJqnwiRELQisWoi404DiWjA==',key_name='tempest-keypair-1009333049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-nhiu05y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:47:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=2cc75551-2782-41ec-b5dc-07bbd62b2e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.objects.instance [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:47:07 user nova-compute[73450]:   <uuid>2cc75551-2782-41ec-b5dc-07bbd62b2e7d</uuid>
Aug 16 16:47:07 user nova-compute[73450]:   <name>instance-00000017</name>
Aug 16 16:47:07 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:47:07 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:47:07 user nova-compute[73450]:   <metadata>
Aug 16 16:47:07 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:47:07 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:47:07 user nova-compute[73450]:       <nova:name>tempest-tempest.common.compute-instance-2063771279</nova:name>
Aug 16 16:47:07 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:47:07</nova:creationTime>
Aug 16 16:47:07 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:47:07 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:47:07 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:47:07 user nova-compute[73450]:       <nova:owner>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:user uuid="cfb44f7411ad47b18d2c58a1dc6ac074">tempest-ServerActionsTestOtherA-1309270761-project-member</nova:user>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:project uuid="db72f2fe40fe410098164a19683782d4">tempest-ServerActionsTestOtherA-1309270761</nova:project>
Aug 16 16:47:07 user nova-compute[73450]:       </nova:owner>
Aug 16 16:47:07 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:47:07 user nova-compute[73450]:       <nova:ports>
Aug 16 16:47:07 user nova-compute[73450]:         <nova:port uuid="584b7d85-9923-49f7-96df-27900e697677">
Aug 16 16:47:07 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 16:47:07 user nova-compute[73450]:         </nova:port>
Aug 16 16:47:07 user nova-compute[73450]:       </nova:ports>
Aug 16 16:47:07 user nova-compute[73450]:     </nova:instance>
Aug 16 16:47:07 user nova-compute[73450]:   </metadata>
Aug 16 16:47:07 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:47:07 user nova-compute[73450]:     <system>
Aug 16 16:47:07 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:47:07 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:47:07 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:47:07 user nova-compute[73450]:       <entry name="serial">2cc75551-2782-41ec-b5dc-07bbd62b2e7d</entry>
Aug 16 16:47:07 user nova-compute[73450]:       <entry name="uuid">2cc75551-2782-41ec-b5dc-07bbd62b2e7d</entry>
Aug 16 16:47:07 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:47:07 user nova-compute[73450]:     </system>
Aug 16 16:47:07 user nova-compute[73450]:   </sysinfo>
Aug 16 16:47:07 user nova-compute[73450]:   <os>
Aug 16 16:47:07 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:47:07 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:47:07 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:47:07 user nova-compute[73450]:   </os>
Aug 16 16:47:07 user nova-compute[73450]:   <features>
Aug 16 16:47:07 user nova-compute[73450]:     <acpi/>
Aug 16 16:47:07 user nova-compute[73450]:     <apic/>
Aug 16 16:47:07 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:47:07 user nova-compute[73450]:   </features>
Aug 16 16:47:07 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:47:07 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:47:07 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:47:07 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:47:07 user nova-compute[73450]:   </clock>
Aug 16 16:47:07 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:47:07 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:47:07 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:47:07 user nova-compute[73450]:   </cpu>
Aug 16 16:47:07 user nova-compute[73450]:   <devices>
Aug 16 16:47:07 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:47:07 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:47:07 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk"/>
Aug 16 16:47:07 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:47:07 user nova-compute[73450]:     </disk>
Aug 16 16:47:07 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:47:07 user nova-compute[73450]:       <mac address="fa:16:3e:5f:6d:f2"/>
Aug 16 16:47:07 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:47:07 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:47:07 user nova-compute[73450]:       <target dev="tap584b7d85-99"/>
Aug 16 16:47:07 user nova-compute[73450]:     </interface>
Aug 16 16:47:07 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:47:07 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/console.log" append="off"/>
Aug 16 16:47:07 user nova-compute[73450]:     </serial>
Aug 16 16:47:07 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:47:07 user nova-compute[73450]:     <video>
Aug 16 16:47:07 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:47:07 user nova-compute[73450]:     </video>
Aug 16 16:47:07 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:47:07 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:47:07 user nova-compute[73450]:     </rng>
Aug 16 16:47:07 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:47:07 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:47:07 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:47:07 user nova-compute[73450]:     </memballoon>
Aug 16 16:47:07 user nova-compute[73450]:   </devices>
Aug 16 16:47:07 user nova-compute[73450]: </domain>
Aug 16 16:47:07 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2063771279',display_name='tempest-tempest.common.compute-instance-2063771279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2063771279',id=23,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQmCjEwBWBT/s+RkkCOjc/eGOP9z0w95KzLeTdPqlgCuTZqJVaN5DjiHNfWqPwKgKEuD9tdNOXK1xjbGitp8WqrUfrXMvUumz62835vCPBQJqnwiRELQisWoi404DiWjA==',key_name='tempest-keypair-1009333049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-nhiu05y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:47:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=2cc75551-2782-41ec-b5dc-07bbd62b2e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG os_vif [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap584b7d85-99, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap584b7d85-99, col_values=(('external_ids', {'iface-id': '584b7d85-9923-49f7-96df-27900e697677', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:6d:f2', 'vm-uuid': '2cc75551-2782-41ec-b5dc-07bbd62b2e7d'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:07 user nova-compute[73450]: INFO os_vif [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99')
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:47:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No VIF found with MAC fa:16:3e:5f:6d:f2, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:47:08 user nova-compute[73450]: DEBUG nova.network.neutron [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updated VIF entry in instance network info cache for port 584b7d85-9923-49f7-96df-27900e697677. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:47:08 user nova-compute[73450]: DEBUG nova.network.neutron [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updating instance_info_cache with network_info: [{"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b21fc7ea-4a4a-4068-bab7-9ff2e01f7750 req-baebcdcb-7084-4342-b93c-dfbd1a586272 service nova] Releasing lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-87c75ad6-e982-4e58-bc8d-ea22e243f80b req-4a3e04f6-38ad-4216-99e8-2c07b80c1df2 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-87c75ad6-e982-4e58-bc8d-ea22e243f80b req-4a3e04f6-38ad-4216-99e8-2c07b80c1df2 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-87c75ad6-e982-4e58-bc8d-ea22e243f80b req-4a3e04f6-38ad-4216-99e8-2c07b80c1df2 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-87c75ad6-e982-4e58-bc8d-ea22e243f80b req-4a3e04f6-38ad-4216-99e8-2c07b80c1df2 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-87c75ad6-e982-4e58-bc8d-ea22e243f80b req-4a3e04f6-38ad-4216-99e8-2c07b80c1df2 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:09 user nova-compute[73450]: WARNING nova.compute.manager [req-87c75ad6-e982-4e58-bc8d-ea22e243f80b req-4a3e04f6-38ad-4216-99e8-2c07b80c1df2 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state building and task_state spawning.
Aug 16 16:47:10 user nova-compute[73450]: INFO nova.compute.manager [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Rescuing
Aug 16 16:47:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:47:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:47:10 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204431.6568987, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] VM Resumed (Lifecycle Event)
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance spawned successfully.
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204431.66044, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] VM Started (Lifecycle Event)
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-2746aa02-5212-4c83-87d6-bdd88bebb27b req-04170564-021e-4162-876e-3a47bbd152f0 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2746aa02-5212-4c83-87d6-bdd88bebb27b req-04170564-021e-4162-876e-3a47bbd152f0 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2746aa02-5212-4c83-87d6-bdd88bebb27b req-04170564-021e-4162-876e-3a47bbd152f0 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2746aa02-5212-4c83-87d6-bdd88bebb27b req-04170564-021e-4162-876e-3a47bbd152f0 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-2746aa02-5212-4c83-87d6-bdd88bebb27b req-04170564-021e-4162-876e-3a47bbd152f0 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:11 user nova-compute[73450]: WARNING nova.compute.manager [req-2746aa02-5212-4c83-87d6-bdd88bebb27b req-04170564-021e-4162-876e-3a47bbd152f0 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state building and task_state spawning.
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 16 16:47:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:11 user nova-compute[73450]: INFO nova.compute.manager [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Took 7.18 seconds to build instance.
Aug 16 16:47:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0f4f0df9-50f4-467e-9405-5dee4c1a924d tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.307s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance destroyed successfully.
Aug 16 16:47:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Attempting rescue
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73450) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:47:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Creating image(s)
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'trusted_certs' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue" returned: 0 in 0.049s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'migration_context' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Start _get_guest_xml network_info=[{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:93:4b:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'resources' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'numa_topology' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:12 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:47:12 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'vcpu_model' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812468752',display_name='tempest-ServerRescueNegativeTestJSON-server-1812468752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812468752',id=13,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:42:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-st8v3bwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:42:30Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=767812ec-7b5d-414e-ae14-a0bb1ccfb13b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:93:4b:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:93:4b:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'pci_devices' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:47:12 user nova-compute[73450]:   <uuid>767812ec-7b5d-414e-ae14-a0bb1ccfb13b</uuid>
Aug 16 16:47:12 user nova-compute[73450]:   <name>instance-0000000d</name>
Aug 16 16:47:12 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:47:12 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:47:12 user nova-compute[73450]:   <metadata>
Aug 16 16:47:12 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:47:12 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:47:12 user nova-compute[73450]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1812468752</nova:name>
Aug 16 16:47:12 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:47:12</nova:creationTime>
Aug 16 16:47:12 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:47:12 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:47:12 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:47:12 user nova-compute[73450]:       <nova:owner>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:user uuid="19d604d793314808984e92afdc5f5da0">tempest-ServerRescueNegativeTestJSON-976614040-project-member</nova:user>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:project uuid="ad178c8525774ad2a342015b9dc1fbf2">tempest-ServerRescueNegativeTestJSON-976614040</nova:project>
Aug 16 16:47:12 user nova-compute[73450]:       </nova:owner>
Aug 16 16:47:12 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:47:12 user nova-compute[73450]:       <nova:ports>
Aug 16 16:47:12 user nova-compute[73450]:         <nova:port uuid="f14ce5dd-9557-437f-b006-8749709a9013">
Aug 16 16:47:12 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:47:12 user nova-compute[73450]:         </nova:port>
Aug 16 16:47:12 user nova-compute[73450]:       </nova:ports>
Aug 16 16:47:12 user nova-compute[73450]:     </nova:instance>
Aug 16 16:47:12 user nova-compute[73450]:   </metadata>
Aug 16 16:47:12 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:47:12 user nova-compute[73450]:     <system>
Aug 16 16:47:12 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:47:12 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:47:12 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:47:12 user nova-compute[73450]:       <entry name="serial">767812ec-7b5d-414e-ae14-a0bb1ccfb13b</entry>
Aug 16 16:47:12 user nova-compute[73450]:       <entry name="uuid">767812ec-7b5d-414e-ae14-a0bb1ccfb13b</entry>
Aug 16 16:47:12 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:47:12 user nova-compute[73450]:     </system>
Aug 16 16:47:12 user nova-compute[73450]:   </sysinfo>
Aug 16 16:47:12 user nova-compute[73450]:   <os>
Aug 16 16:47:12 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:47:12 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:47:12 user nova-compute[73450]:   </os>
Aug 16 16:47:12 user nova-compute[73450]:   <features>
Aug 16 16:47:12 user nova-compute[73450]:     <acpi/>
Aug 16 16:47:12 user nova-compute[73450]:     <apic/>
Aug 16 16:47:12 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:47:12 user nova-compute[73450]:   </features>
Aug 16 16:47:12 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:47:12 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:47:12 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:47:12 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:47:12 user nova-compute[73450]:   </clock>
Aug 16 16:47:12 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:47:12 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:47:12 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:47:12 user nova-compute[73450]:   </cpu>
Aug 16 16:47:12 user nova-compute[73450]:   <devices>
Aug 16 16:47:12 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:47:12 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:47:12 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue"/>
Aug 16 16:47:12 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:47:12 user nova-compute[73450]:     </disk>
Aug 16 16:47:12 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:47:12 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:47:12 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk"/>
Aug 16 16:47:12 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:47:12 user nova-compute[73450]:     </disk>
Aug 16 16:47:12 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:47:12 user nova-compute[73450]:       <mac address="fa:16:3e:93:4b:c7"/>
Aug 16 16:47:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:47:12 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:47:12 user nova-compute[73450]:       <target dev="tapf14ce5dd-95"/>
Aug 16 16:47:12 user nova-compute[73450]:     </interface>
Aug 16 16:47:12 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:47:12 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/console.log" append="off"/>
Aug 16 16:47:12 user nova-compute[73450]:     </serial>
Aug 16 16:47:12 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:47:12 user nova-compute[73450]:     <video>
Aug 16 16:47:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:47:12 user nova-compute[73450]:     </video>
Aug 16 16:47:12 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:47:12 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:47:12 user nova-compute[73450]:     </rng>
Aug 16 16:47:12 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:47:12 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:47:12 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:47:12 user nova-compute[73450]:     </memballoon>
Aug 16 16:47:12 user nova-compute[73450]:   </devices>
Aug 16 16:47:12 user nova-compute[73450]: </domain>
Aug 16 16:47:12 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:47:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance destroyed successfully.
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:93:4b:c7, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:13 user nova-compute[73450]: WARNING nova.compute.manager [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state active and task_state rescuing.
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:13 user nova-compute[73450]: WARNING nova.compute.manager [req-5d6a1d3c-37b9-46b4-9ecf-8d4e3deddfea req-77728440-1bd9-4dca-a83a-fd1d2a870119 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state active and task_state rescuing.
Aug 16 16:47:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-fa6c257e-9bee-42e7-beaf-c33326086870 req-282bca6e-14aa-49fc-9cee-52ed40296465 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fa6c257e-9bee-42e7-beaf-c33326086870 req-282bca6e-14aa-49fc-9cee-52ed40296465 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fa6c257e-9bee-42e7-beaf-c33326086870 req-282bca6e-14aa-49fc-9cee-52ed40296465 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fa6c257e-9bee-42e7-beaf-c33326086870 req-282bca6e-14aa-49fc-9cee-52ed40296465 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-fa6c257e-9bee-42e7-beaf-c33326086870 req-282bca6e-14aa-49fc-9cee-52ed40296465 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:15 user nova-compute[73450]: WARNING nova.compute.manager [req-fa6c257e-9bee-42e7-beaf-c33326086870 req-282bca6e-14aa-49fc-9cee-52ed40296465 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state active and task_state rescuing.
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 767812ec-7b5d-414e-ae14-a0bb1ccfb13b due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204437.3381758, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Resumed (Lifecycle Event)
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f676fde0-6edc-4e47-b72b-6d06a3d2d4a1 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:47:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204437.3428485, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Started (Lifecycle Event)
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:47:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-87fd7618-33a6-4e27-94ca-6a7aec4f0edb req-6aabfc19-bcde-4329-80ac-759c19352174 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-87fd7618-33a6-4e27-94ca-6a7aec4f0edb req-6aabfc19-bcde-4329-80ac-759c19352174 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-87fd7618-33a6-4e27-94ca-6a7aec4f0edb req-6aabfc19-bcde-4329-80ac-759c19352174 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-87fd7618-33a6-4e27-94ca-6a7aec4f0edb req-6aabfc19-bcde-4329-80ac-759c19352174 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-87fd7618-33a6-4e27-94ca-6a7aec4f0edb req-6aabfc19-bcde-4329-80ac-759c19352174 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:18 user nova-compute[73450]: WARNING nova.compute.manager [req-87fd7618-33a6-4e27-94ca-6a7aec4f0edb req-6aabfc19-bcde-4329-80ac-759c19352174 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state None.
Aug 16 16:47:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing instance network info cache due to event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:47:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:47:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:47:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:47:24 user nova-compute[73450]: DEBUG nova.network.neutron [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updated VIF entry in instance network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:47:24 user nova-compute[73450]: DEBUG nova.network.neutron [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-39a3d20a-571f-4103-9657-f28b6f9495a7 req-4291367d-358f-4eba-8f1e-e3037656797a service nova] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:47:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:24 user nova-compute[73450]: INFO nova.compute.manager [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] instance snapshotting
Aug 16 16:47:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Beginning live snapshot process
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.249s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphx7uuvmr/3091450669d14e50a680c25d9a46c718.delta 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphx7uuvmr/3091450669d14e50a680c25d9a46c718.delta 1073741824" returned: 0 in 0.061s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 16:47:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:47:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:47:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 16:47:27 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:47:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphx7uuvmr/3091450669d14e50a680c25d9a46c718.delta /opt/stack/data/nova/instances/snapshots/tmphx7uuvmr/3091450669d14e50a680c25d9a46c718 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphx7uuvmr/3091450669d14e50a680c25d9a46c718.delta /opt/stack/data/nova/instances/snapshots/tmphx7uuvmr/3091450669d14e50a680c25d9a46c718" returned: 0 in 0.371s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Snapshot extracted, beginning image upload
Aug 16 16:47:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Snapshot image upload complete
Aug 16 16:47:30 user nova-compute[73450]: INFO nova.compute.manager [None req-23140ecd-47e9-4f59-957f-76cf9672f9c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Took 5.90 seconds to snapshot the instance on the hypervisor.
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:31 user nova-compute[73450]: INFO nova.compute.manager [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Terminating instance
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-abf19eb3-2adf-49df-8ac4-db6d1f877ebe req-80527326-ce7d-49a8-9430-d2b059e7d610 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-vif-unplugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-abf19eb3-2adf-49df-8ac4-db6d1f877ebe req-80527326-ce7d-49a8-9430-d2b059e7d610 service nova] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-abf19eb3-2adf-49df-8ac4-db6d1f877ebe req-80527326-ce7d-49a8-9430-d2b059e7d610 service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-abf19eb3-2adf-49df-8ac4-db6d1f877ebe req-80527326-ce7d-49a8-9430-d2b059e7d610 service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-abf19eb3-2adf-49df-8ac4-db6d1f877ebe req-80527326-ce7d-49a8-9430-d2b059e7d610 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] No waiting events found dispatching network-vif-unplugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-abf19eb3-2adf-49df-8ac4-db6d1f877ebe req-80527326-ce7d-49a8-9430-d2b059e7d610 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-vif-unplugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:47:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Instance destroyed successfully.
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lazy-loading 'resources' on Instance uuid 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2114288902',display_name='tempest-VolumesNegativeTest-instance-2114288902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2114288902',id=21,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ea8e58c03c24ec7bbdaebc59f173f8c',ramdisk_id='',reservation_id='r-s6pnzfhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1228748228',owner_user_name='tempest-VolumesNegativeTest-1228748228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:45:49Z,user_data=None,user_id='88be8b346f5a4c9bae4ed3f2642bcbc2',uuid=8581b8bb-99a8-4182-9e1f-781ee0c9e8c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Converting VIF {"id": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "address": "fa:16:3e:a0:9a:b9", "network": {"id": "456c3d92-c01c-47d6-a122-a359d7c6280e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053b6ba3f029484e96d0d210f0c815dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb170b2c1-66", "ovs_interfaceid": "b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:47:31 user nova-compute[73450]: DEBUG os_vif [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb170b2c1-66, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:32 user nova-compute[73450]: INFO os_vif [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9a:b9,bridge_name='br-int',has_traffic_filtering=True,id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db,network=Network(456c3d92-c01c-47d6-a122-a359d7c6280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb170b2c1-66')
Aug 16 16:47:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Deleting instance files /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3_del
Aug 16 16:47:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Deletion of /opt/stack/data/nova/instances/8581b8bb-99a8-4182-9e1f-781ee0c9e8c3_del complete
Aug 16 16:47:32 user nova-compute[73450]: INFO nova.compute.manager [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 16:47:32 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:32 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Took 0.76 seconds to deallocate network for instance.
Aug 16 16:47:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-7947586e-398c-4a7e-a745-ca56a63889b3 req-4392f5a8-2313-4f13-bc86-a6a615a58091 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-vif-deleted-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:32 user nova-compute[73450]: INFO nova.compute.manager [req-7947586e-398c-4a7e-a745-ca56a63889b3 req-4392f5a8-2313-4f13-bc86-a6a615a58091 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Neutron deleted interface b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db; detaching it from the instance and deleting it from the info cache
Aug 16 16:47:32 user nova-compute[73450]: DEBUG nova.network.neutron [req-7947586e-398c-4a7e-a745-ca56a63889b3 req-4392f5a8-2313-4f13-bc86-a6a615a58091 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-7947586e-398c-4a7e-a745-ca56a63889b3 req-4392f5a8-2313-4f13-bc86-a6a615a58091 service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Detach interface failed, port_id=b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db, reason: Instance 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:33 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Deleted allocations for instance 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3
Aug 16 16:47:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9acb6fbe-5fdb-44e2-bf00-46092ced207b tempest-VolumesNegativeTest-1228748228 tempest-VolumesNegativeTest-1228748228-project-member] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-cbfdbb07-c3ca-4900-a4ba-b7ac81702e29 req-051b21ea-9617-4469-b786-fea23b8f0f4f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received event network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cbfdbb07-c3ca-4900-a4ba-b7ac81702e29 req-051b21ea-9617-4469-b786-fea23b8f0f4f service nova] Acquiring lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cbfdbb07-c3ca-4900-a4ba-b7ac81702e29 req-051b21ea-9617-4469-b786-fea23b8f0f4f service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cbfdbb07-c3ca-4900-a4ba-b7ac81702e29 req-051b21ea-9617-4469-b786-fea23b8f0f4f service nova] Lock "8581b8bb-99a8-4182-9e1f-781ee0c9e8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-cbfdbb07-c3ca-4900-a4ba-b7ac81702e29 req-051b21ea-9617-4469-b786-fea23b8f0f4f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] No waiting events found dispatching network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:33 user nova-compute[73450]: WARNING nova.compute.manager [req-cbfdbb07-c3ca-4900-a4ba-b7ac81702e29 req-051b21ea-9617-4469-b786-fea23b8f0f4f service nova] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Received unexpected event network-vif-plugged-b170b2c1-66e7-4a9d-a4bc-e4e3ee10e6db for instance with vm_state deleted and task_state None.
Aug 16 16:47:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "66f48511-dafc-457b-817e-5bfe039cefa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:43 user nova-compute[73450]: INFO nova.compute.manager [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Terminating instance
Aug 16 16:47:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-7bdaf2aa-fb1e-4c83-b74f-0bfb14af87f6 req-496b988c-a267-4de5-94a8-6e01e55bd2c4 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-vif-unplugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7bdaf2aa-fb1e-4c83-b74f-0bfb14af87f6 req-496b988c-a267-4de5-94a8-6e01e55bd2c4 service nova] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7bdaf2aa-fb1e-4c83-b74f-0bfb14af87f6 req-496b988c-a267-4de5-94a8-6e01e55bd2c4 service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7bdaf2aa-fb1e-4c83-b74f-0bfb14af87f6 req-496b988c-a267-4de5-94a8-6e01e55bd2c4 service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-7bdaf2aa-fb1e-4c83-b74f-0bfb14af87f6 req-496b988c-a267-4de5-94a8-6e01e55bd2c4 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] No waiting events found dispatching network-vif-unplugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-7bdaf2aa-fb1e-4c83-b74f-0bfb14af87f6 req-496b988c-a267-4de5-94a8-6e01e55bd2c4 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-vif-unplugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Instance destroyed successfully.
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lazy-loading 'resources' on Instance uuid 66f48511-dafc-457b-817e-5bfe039cefa1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1548574365',display_name='tempest-ServersNegativeTestJSON-server-1548574365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1548574365',id=1,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e78ad8f16dae4525b9aecc767f42a261',ramdisk_id='',reservation_id='r-ib7p5b01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1651503421',owner_user_name='tempest-ServersNegativeTestJSON-1651503421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:39:06Z,user_data=None,user_id='b725deabeb954813950dc1841e6a09fc',uuid=66f48511-dafc-457b-817e-5bfe039cefa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converting VIF {"id": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "address": "fa:16:3e:93:f5:37", "network": {"id": "641943ab-c0a7-49fd-8675-d4c55e21b54b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1198797812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e78ad8f16dae4525b9aecc767f42a261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce6432f-ad", "ovs_interfaceid": "dce6432f-ad3b-4aaa-9c5b-928e87b9a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG os_vif [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdce6432f-ad, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:44 user nova-compute[73450]: INFO os_vif [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=dce6432f-ad3b-4aaa-9c5b-928e87b9a711,network=Network(641943ab-c0a7-49fd-8675-d4c55e21b54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce6432f-ad')
Aug 16 16:47:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Deleting instance files /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1_del
Aug 16 16:47:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Deletion of /opt/stack/data/nova/instances/66f48511-dafc-457b-817e-5bfe039cefa1_del complete
Aug 16 16:47:44 user nova-compute[73450]: INFO nova.compute.manager [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 16 16:47:44 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:44 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Took 0.55 seconds to deallocate network for instance.
Aug 16 16:47:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-1d0359da-25cd-4e36-a099-3423f54f1c81 req-56b48f30-f8d7-4741-88e2-601ea16f2526 service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-vif-deleted-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:45 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Deleted allocations for instance 66f48511-dafc-457b-817e-5bfe039cefa1
Aug 16 16:47:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:47:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-67873972-b5cb-4123-b5ef-6e941143b5b8 tempest-ServersNegativeTestJSON-1651503421 tempest-ServersNegativeTestJSON-1651503421-project-member] Lock "66f48511-dafc-457b-817e-5bfe039cefa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-0766a7b1-4674-4f08-9e99-7230142e6a00 req-92399a83-e900-4eee-bd0b-09059744265d service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received event network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0766a7b1-4674-4f08-9e99-7230142e6a00 req-92399a83-e900-4eee-bd0b-09059744265d service nova] Acquiring lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0766a7b1-4674-4f08-9e99-7230142e6a00 req-92399a83-e900-4eee-bd0b-09059744265d service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0766a7b1-4674-4f08-9e99-7230142e6a00 req-92399a83-e900-4eee-bd0b-09059744265d service nova] Lock "66f48511-dafc-457b-817e-5bfe039cefa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-0766a7b1-4674-4f08-9e99-7230142e6a00 req-92399a83-e900-4eee-bd0b-09059744265d service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] No waiting events found dispatching network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:47:46 user nova-compute[73450]: WARNING nova.compute.manager [req-0766a7b1-4674-4f08-9e99-7230142e6a00 req-92399a83-e900-4eee-bd0b-09059744265d service nova] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Received unexpected event network-vif-plugged-dce6432f-ad3b-4aaa-9c5b-928e87b9a711 for instance with vm_state deleted and task_state None.
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:46 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204451.9672453, 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:46 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] VM Stopped (Lifecycle Event)
Aug 16 16:47:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a11bc589-c483-45fe-bd7e-6f7022439eda None None] [instance: 8581b8bb-99a8-4182-9e1f-781ee0c9e8c3] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:47:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:47:50 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:47:50 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7492MB free_disk=24.088462829589844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:47:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:47:51 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:51 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:51 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:47:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:59 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204464.2387297, 66f48511-dafc-457b-817e-5bfe039cefa1 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:47:59 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] VM Stopped (Lifecycle Event)
Aug 16 16:47:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-abcb358d-29e1-458f-b044-8f7d7c8c8f2c None None] [instance: 66f48511-dafc-457b-817e-5bfe039cefa1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:47:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:47:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:48:13 user nova-compute[73450]: INFO nova.compute.claims [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Claim successful on node user
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "05300534-a2db-4aa6-959e-a9a643064c4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.010s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:48:13 user nova-compute[73450]: INFO nova.compute.claims [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Claim successful on node user
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:48:13 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:48:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.policy [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3751e571d8dc4a90814f4004d66d6d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd102b4e156e94b29a674fa550700504e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:48:14 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Creating image(s)
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "/opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "/opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "/opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.292s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.222s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk 1073741824" returned: 0 in 0.070s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:14 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:48:14 user nova-compute[73450]: INFO nova.virt.block_device [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Booting with volume snapshot 39eb55f9-53e0-4197-8eaf-4aa69815c4ba at /dev/vda
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.policy [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c95d246b43b45b4963f9d750ae89fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b953d82d634106aa0fb9574fafdc0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.279s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:14 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Successfully created port: d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Cannot resize image /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'migration_context' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Ensure instance console log exists: /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Successfully created port: efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Successfully updated port: d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquired lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-changed-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Refreshing instance network info cache due to event network-changed-d20f08f0-eaf2-4455-a575-cc94e95e549a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] Acquiring lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating instance_info_cache with network_info: [{"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Releasing lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Instance network_info: |[{"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] Acquired lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Refreshing network info cache for port d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Start _get_guest_xml network_info=[{"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:48:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1004582045',display_name='tempest-SnapshotDataIntegrityTests-server-1004582045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1004582045',id=24,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANPGc145a5ACfnoFTKYN6Q02CANqk9EEDtAi4uQfTqQWSzanZoHHP0futeEbXRFN0CGNNmyVA2IFHT6N6hy5Q8COkSuL7nDRlzV9xrB26jND6lgMu56osQkyypzUBur5w==',key_name='tempest-keypair-554288138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d102b4e156e94b29a674fa550700504e',ramdisk_id='',reservation_id='r-ymu8tr11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-870667565',owner_user_name='tempest-SnapshotDataIntegrityTests-870667565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3751e571d8dc4a90814f4004d66d6d20',uuid=0340c20a-c2c8-409f-bd43-0a91880f8f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Converting VIF {"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'pci_devices' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:48:16 user nova-compute[73450]:   <uuid>0340c20a-c2c8-409f-bd43-0a91880f8f87</uuid>
Aug 16 16:48:16 user nova-compute[73450]:   <name>instance-00000018</name>
Aug 16 16:48:16 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:48:16 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:48:16 user nova-compute[73450]:   <metadata>
Aug 16 16:48:16 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:48:16 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:48:16 user nova-compute[73450]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1004582045</nova:name>
Aug 16 16:48:16 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:48:16</nova:creationTime>
Aug 16 16:48:16 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:48:16 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:48:16 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:48:16 user nova-compute[73450]:       <nova:owner>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:user uuid="3751e571d8dc4a90814f4004d66d6d20">tempest-SnapshotDataIntegrityTests-870667565-project-member</nova:user>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:project uuid="d102b4e156e94b29a674fa550700504e">tempest-SnapshotDataIntegrityTests-870667565</nova:project>
Aug 16 16:48:16 user nova-compute[73450]:       </nova:owner>
Aug 16 16:48:16 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:48:16 user nova-compute[73450]:       <nova:ports>
Aug 16 16:48:16 user nova-compute[73450]:         <nova:port uuid="d20f08f0-eaf2-4455-a575-cc94e95e549a">
Aug 16 16:48:16 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:48:16 user nova-compute[73450]:         </nova:port>
Aug 16 16:48:16 user nova-compute[73450]:       </nova:ports>
Aug 16 16:48:16 user nova-compute[73450]:     </nova:instance>
Aug 16 16:48:16 user nova-compute[73450]:   </metadata>
Aug 16 16:48:16 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:48:16 user nova-compute[73450]:     <system>
Aug 16 16:48:16 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:48:16 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:48:16 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:48:16 user nova-compute[73450]:       <entry name="serial">0340c20a-c2c8-409f-bd43-0a91880f8f87</entry>
Aug 16 16:48:16 user nova-compute[73450]:       <entry name="uuid">0340c20a-c2c8-409f-bd43-0a91880f8f87</entry>
Aug 16 16:48:16 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:48:16 user nova-compute[73450]:     </system>
Aug 16 16:48:16 user nova-compute[73450]:   </sysinfo>
Aug 16 16:48:16 user nova-compute[73450]:   <os>
Aug 16 16:48:16 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:48:16 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:48:16 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:48:16 user nova-compute[73450]:   </os>
Aug 16 16:48:16 user nova-compute[73450]:   <features>
Aug 16 16:48:16 user nova-compute[73450]:     <acpi/>
Aug 16 16:48:16 user nova-compute[73450]:     <apic/>
Aug 16 16:48:16 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:48:16 user nova-compute[73450]:   </features>
Aug 16 16:48:16 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:48:16 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:48:16 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:48:16 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:48:16 user nova-compute[73450]:   </clock>
Aug 16 16:48:16 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:48:16 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:48:16 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:48:16 user nova-compute[73450]:   </cpu>
Aug 16 16:48:16 user nova-compute[73450]:   <devices>
Aug 16 16:48:16 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:48:16 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:48:16 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk"/>
Aug 16 16:48:16 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:48:16 user nova-compute[73450]:     </disk>
Aug 16 16:48:16 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:48:16 user nova-compute[73450]:       <mac address="fa:16:3e:60:ff:4b"/>
Aug 16 16:48:16 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:48:16 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:48:16 user nova-compute[73450]:       <target dev="tapd20f08f0-ea"/>
Aug 16 16:48:16 user nova-compute[73450]:     </interface>
Aug 16 16:48:16 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:48:16 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/console.log" append="off"/>
Aug 16 16:48:16 user nova-compute[73450]:     </serial>
Aug 16 16:48:16 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:48:16 user nova-compute[73450]:     <video>
Aug 16 16:48:16 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:48:16 user nova-compute[73450]:     </video>
Aug 16 16:48:16 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:48:16 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:48:16 user nova-compute[73450]:     </rng>
Aug 16 16:48:16 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:48:16 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:48:16 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:48:16 user nova-compute[73450]:     </memballoon>
Aug 16 16:48:16 user nova-compute[73450]:   </devices>
Aug 16 16:48:16 user nova-compute[73450]: </domain>
Aug 16 16:48:16 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1004582045',display_name='tempest-SnapshotDataIntegrityTests-server-1004582045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1004582045',id=24,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANPGc145a5ACfnoFTKYN6Q02CANqk9EEDtAi4uQfTqQWSzanZoHHP0futeEbXRFN0CGNNmyVA2IFHT6N6hy5Q8COkSuL7nDRlzV9xrB26jND6lgMu56osQkyypzUBur5w==',key_name='tempest-keypair-554288138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d102b4e156e94b29a674fa550700504e',ramdisk_id='',reservation_id='r-ymu8tr11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-870667565',owner_user_name='tempest-SnapshotDataIntegrityTests-870667565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3751e571d8dc4a90814f4004d66d6d20',uuid=0340c20a-c2c8-409f-bd43-0a91880f8f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Converting VIF {"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG os_vif [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20f08f0-ea, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd20f08f0-ea, col_values=(('external_ids', {'iface-id': 'd20f08f0-eaf2-4455-a575-cc94e95e549a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:ff:4b', 'vm-uuid': '0340c20a-c2c8-409f-bd43-0a91880f8f87'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:16 user nova-compute[73450]: INFO os_vif [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea')
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No VIF found with MAC fa:16:3e:60:ff:4b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Successfully updated port: efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "refresh_cache-05300534-a2db-4aa6-959e-a9a643064c4d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquired lock "refresh_cache-05300534-a2db-4aa6-959e-a9a643064c4d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-changed-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Refreshing instance network info cache due to event network-changed-efbc51fe-58ba-4e8e-887c-04c0ad83a51a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:48:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] Acquiring lock "refresh_cache-05300534-a2db-4aa6-959e-a9a643064c4d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG nova.network.neutron [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updated VIF entry in instance network info cache for port d20f08f0-eaf2-4455-a575-cc94e95e549a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG nova.network.neutron [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating instance_info_cache with network_info: [{"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c9d76ca-c717-431e-b103-e9f9609ebd4d req-dc6d306c-c90c-4dce-b4c4-7984fe63903a service nova] Releasing lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Updating instance_info_cache with network_info: [{"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Releasing lock "refresh_cache-05300534-a2db-4aa6-959e-a9a643064c4d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Instance network_info: |[{"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] Acquired lock "refresh_cache-05300534-a2db-4aa6-959e-a9a643064c4d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:17 user nova-compute[73450]: DEBUG nova.network.neutron [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Refreshing network info cache for port efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Updated VIF entry in instance network info cache for port efbc51fe-58ba-4e8e-887c-04c0ad83a51a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Updating instance_info_cache with network_info: [{"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c173391-fa0f-4d5e-a93f-96443f9d8d14 req-a7b4cb7f-8adc-4293-a72c-b65b8b7db21b service nova] Releasing lock "refresh_cache-05300534-a2db-4aa6-959e-a9a643064c4d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-89e2b76f-cbea-43a1-a770-f765db5629da req-e9a992e7-20f3-48bf-b64c-779e52975924 service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-89e2b76f-cbea-43a1-a770-f765db5629da req-e9a992e7-20f3-48bf-b64c-779e52975924 service nova] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-89e2b76f-cbea-43a1-a770-f765db5629da req-e9a992e7-20f3-48bf-b64c-779e52975924 service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-89e2b76f-cbea-43a1-a770-f765db5629da req-e9a992e7-20f3-48bf-b64c-779e52975924 service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-89e2b76f-cbea-43a1-a770-f765db5629da req-e9a992e7-20f3-48bf-b64c-779e52975924 service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] No waiting events found dispatching network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:18 user nova-compute[73450]: WARNING nova.compute.manager [req-89e2b76f-cbea-43a1-a770-f765db5629da req-e9a992e7-20f3-48bf-b64c-779e52975924 service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received unexpected event network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a for instance with vm_state building and task_state spawning.
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:48:18 user nova-compute[73450]: INFO nova.compute.claims [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Claim successful on node user
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:48:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:48:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.policy [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3275ae2aaad34aa8adb49e5de0dbe238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f813e9d59945b58a7f0141fb29ca46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:48:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Creating image(s)
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk 1073741824" returned: 0 in 0.051s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Successfully created port: 8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Cannot resize image /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'migration_context' on Instance uuid 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Ensure instance console log exists: /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204500.3380241, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] VM Resumed (Lifecycle Event)
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Instance spawned successfully.
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204500.3404763, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] VM Started (Lifecycle Event)
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-10709eb4-99be-402c-b307-77bda12ce801 req-ec280acf-1a24-4684-9158-518247e2d64f service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10709eb4-99be-402c-b307-77bda12ce801 req-ec280acf-1a24-4684-9158-518247e2d64f service nova] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10709eb4-99be-402c-b307-77bda12ce801 req-ec280acf-1a24-4684-9158-518247e2d64f service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10709eb4-99be-402c-b307-77bda12ce801 req-ec280acf-1a24-4684-9158-518247e2d64f service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-10709eb4-99be-402c-b307-77bda12ce801 req-ec280acf-1a24-4684-9158-518247e2d64f service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] No waiting events found dispatching network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:20 user nova-compute[73450]: WARNING nova.compute.manager [req-10709eb4-99be-402c-b307-77bda12ce801 req-ec280acf-1a24-4684-9158-518247e2d64f service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received unexpected event network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a for instance with vm_state building and task_state spawning.
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 16 16:48:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:20 user nova-compute[73450]: INFO nova.compute.manager [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Took 7.21 seconds to build instance.
Aug 16 16:48:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9aa47db8-32a5-4858-bb50-b0944a24a0a2 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.365s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Successfully updated port: 8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-changed-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Refreshing instance network info cache due to event network-changed-8c191e63-c777-4bbd-b590-2f5d90d33dc7. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] Acquiring lock "refresh_cache-1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Updating instance_info_cache with network_info: [{"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Instance network_info: |[{"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] Acquired lock "refresh_cache-1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.neutron [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Refreshing network info cache for port 8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Start _get_guest_xml network_info=[{"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:48:21 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:21 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163959128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163959128',id=26,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-k0neywtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:19Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:48:21 user nova-compute[73450]:   <uuid>1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4</uuid>
Aug 16 16:48:21 user nova-compute[73450]:   <name>instance-0000001a</name>
Aug 16 16:48:21 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:48:21 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:48:21 user nova-compute[73450]:   <metadata>
Aug 16 16:48:21 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:48:21 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:48:21 user nova-compute[73450]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1163959128</nova:name>
Aug 16 16:48:21 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:48:21</nova:creationTime>
Aug 16 16:48:21 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:48:21 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:48:21 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:48:21 user nova-compute[73450]:       <nova:owner>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:user uuid="3275ae2aaad34aa8adb49e5de0dbe238">tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member</nova:user>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:project uuid="88f813e9d59945b58a7f0141fb29ca46">tempest-ServerBootFromVolumeStableRescueTest-311543227</nova:project>
Aug 16 16:48:21 user nova-compute[73450]:       </nova:owner>
Aug 16 16:48:21 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:48:21 user nova-compute[73450]:       <nova:ports>
Aug 16 16:48:21 user nova-compute[73450]:         <nova:port uuid="8c191e63-c777-4bbd-b590-2f5d90d33dc7">
Aug 16 16:48:21 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 16:48:21 user nova-compute[73450]:         </nova:port>
Aug 16 16:48:21 user nova-compute[73450]:       </nova:ports>
Aug 16 16:48:21 user nova-compute[73450]:     </nova:instance>
Aug 16 16:48:21 user nova-compute[73450]:   </metadata>
Aug 16 16:48:21 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:48:21 user nova-compute[73450]:     <system>
Aug 16 16:48:21 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:48:21 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:48:21 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:48:21 user nova-compute[73450]:       <entry name="serial">1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4</entry>
Aug 16 16:48:21 user nova-compute[73450]:       <entry name="uuid">1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4</entry>
Aug 16 16:48:21 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:48:21 user nova-compute[73450]:     </system>
Aug 16 16:48:21 user nova-compute[73450]:   </sysinfo>
Aug 16 16:48:21 user nova-compute[73450]:   <os>
Aug 16 16:48:21 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:48:21 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:48:21 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:48:21 user nova-compute[73450]:   </os>
Aug 16 16:48:21 user nova-compute[73450]:   <features>
Aug 16 16:48:21 user nova-compute[73450]:     <acpi/>
Aug 16 16:48:21 user nova-compute[73450]:     <apic/>
Aug 16 16:48:21 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:48:21 user nova-compute[73450]:   </features>
Aug 16 16:48:21 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:48:21 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:48:21 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:48:21 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:48:21 user nova-compute[73450]:   </clock>
Aug 16 16:48:21 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:48:21 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:48:21 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:48:21 user nova-compute[73450]:   </cpu>
Aug 16 16:48:21 user nova-compute[73450]:   <devices>
Aug 16 16:48:21 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:48:21 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:48:21 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk"/>
Aug 16 16:48:21 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:48:21 user nova-compute[73450]:     </disk>
Aug 16 16:48:21 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:48:21 user nova-compute[73450]:       <mac address="fa:16:3e:ff:f5:7e"/>
Aug 16 16:48:21 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:48:21 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:48:21 user nova-compute[73450]:       <target dev="tap8c191e63-c7"/>
Aug 16 16:48:21 user nova-compute[73450]:     </interface>
Aug 16 16:48:21 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:48:21 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/console.log" append="off"/>
Aug 16 16:48:21 user nova-compute[73450]:     </serial>
Aug 16 16:48:21 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:48:21 user nova-compute[73450]:     <video>
Aug 16 16:48:21 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:48:21 user nova-compute[73450]:     </video>
Aug 16 16:48:21 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:48:21 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:48:21 user nova-compute[73450]:     </rng>
Aug 16 16:48:21 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:48:21 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:48:21 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:48:21 user nova-compute[73450]:     </memballoon>
Aug 16 16:48:21 user nova-compute[73450]:   </devices>
Aug 16 16:48:21 user nova-compute[73450]: </domain>
Aug 16 16:48:21 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163959128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163959128',id=26,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-k0neywtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:19Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG os_vif [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c191e63-c7, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c191e63-c7, col_values=(('external_ids', {'iface-id': '8c191e63-c777-4bbd-b590-2f5d90d33dc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:f5:7e', 'vm-uuid': '1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:21 user nova-compute[73450]: INFO os_vif [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7')
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:48:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No VIF found with MAC fa:16:3e:ff:f5:7e, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:48:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Updated VIF entry in instance network info cache for port 8c191e63-c777-4bbd-b590-2f5d90d33dc7. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:48:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Updating instance_info_cache with network_info: [{"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-83b0f97e-01e1-4be8-b3ed-589123ce1e1a req-7d9be9fc-19ac-44d8-8637-29ce2934f0dc service nova] Releasing lock "refresh_cache-1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-570cb99e-88e6-4c2d-ad52-9c6465cb8a23 req-9f323cfc-65d5-4156-bb25-576c05912170 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-570cb99e-88e6-4c2d-ad52-9c6465cb8a23 req-9f323cfc-65d5-4156-bb25-576c05912170 service nova] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-570cb99e-88e6-4c2d-ad52-9c6465cb8a23 req-9f323cfc-65d5-4156-bb25-576c05912170 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-570cb99e-88e6-4c2d-ad52-9c6465cb8a23 req-9f323cfc-65d5-4156-bb25-576c05912170 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-570cb99e-88e6-4c2d-ad52-9c6465cb8a23 req-9f323cfc-65d5-4156-bb25-576c05912170 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] No waiting events found dispatching network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:23 user nova-compute[73450]: WARNING nova.compute.manager [req-570cb99e-88e6-4c2d-ad52-9c6465cb8a23 req-9f323cfc-65d5-4156-bb25-576c05912170 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received unexpected event network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 for instance with vm_state building and task_state spawning.
Aug 16 16:48:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204505.49966, 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] VM Resumed (Lifecycle Event)
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Instance spawned successfully.
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204505.5048938, 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] VM Started (Lifecycle Event)
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-9dc9f5ad-588c-450c-9c15-50730b79abd0 req-66a424fb-8edb-46c1-8239-a93c9e2754a1 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9dc9f5ad-588c-450c-9c15-50730b79abd0 req-66a424fb-8edb-46c1-8239-a93c9e2754a1 service nova] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9dc9f5ad-588c-450c-9c15-50730b79abd0 req-66a424fb-8edb-46c1-8239-a93c9e2754a1 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9dc9f5ad-588c-450c-9c15-50730b79abd0 req-66a424fb-8edb-46c1-8239-a93c9e2754a1 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-9dc9f5ad-588c-450c-9c15-50730b79abd0 req-66a424fb-8edb-46c1-8239-a93c9e2754a1 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] No waiting events found dispatching network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:25 user nova-compute[73450]: WARNING nova.compute.manager [req-9dc9f5ad-588c-450c-9c15-50730b79abd0 req-66a424fb-8edb-46c1-8239-a93c9e2754a1 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received unexpected event network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 for instance with vm_state building and task_state spawning.
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Took 6.32 seconds to spawn the instance on the hypervisor.
Aug 16 16:48:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:48:25 user nova-compute[73450]: INFO nova.compute.manager [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Took 7.17 seconds to build instance.
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d692d097-510b-49dc-b3c0-37d07981439d tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.274s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG os_brick.utils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee21e1-bfde-4f60-bde2-f2292c32b9b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c93bb9-6e90-44c8-8a84-60b9d3ba123e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f00b5d7-b375-44a0-a71d-05ea4a28f84f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b55f8c-6443-40e9-aaa1-6c320348a46f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:26 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:48:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9486bf4-8fdc-4fa3-85b9-d865c02b886c]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG os_brick.utils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Updating existing volume attachment record: 34e1a0bc-e375-4e79-932b-f7bdced58901 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:48:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-changed-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Refreshing instance network info cache due to event network-changed-4a62f6e8-e050-4dae-90ee-7b0724310e90. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] Acquiring lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] Acquired lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Refreshing network info cache for port 4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updated VIF entry in instance network info cache for port 4a62f6e8-e050-4dae-90ee-7b0724310e90. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating instance_info_cache with network_info: [{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-afa77afa-2978-491a-ae6e-33e8184ef5bb req-23deb382-27a2-471c-a32d-166a6ed36850 service nova] Releasing lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:33 user nova-compute[73450]: INFO nova.compute.manager [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Attaching volume b31eddbc-5530-48a8-886b-3ae816f6d7f4 to /dev/vdb
Aug 16 16:48:33 user nova-compute[73450]: DEBUG os_brick.utils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c00d58-0887-4762-92ca-e4e04f8db585]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9056ab-a32a-4750-a706-e65236fff047]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[134aac5e-c0b0-4073-bf51-3ed09a0fd9d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b29da-b09c-4822-80a0-6c4671592a3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:33 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:48:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee15294-3f61-4f3d-818d-b0d2c25ec16c]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG os_brick.utils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:48:33 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating existing volume attachment record: 71619342-ccfe-443e-9fde-7215d74de685 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:48:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:48:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Creating image(s)
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Ensure instance console log exists: /opt/stack/data/nova/instances/05300534-a2db-4aa6-959e-a9a643064c4d/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Start _get_guest_xml network_info=[{"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '34e1a0bc-e375-4e79-932b-f7bdced58901', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYTxFfoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05300534-a2db-4aa6-959e-a9a643064c4d', 'attached_at': '', 'detached_at': '', 'volume_id': '9c87a2a0-9e97-4d1d-a12a-b2cba0196815', 'serial': '9c87a2a0-9e97-4d1d-a12a-b2cba0196815'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:48:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYTxFfoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:48:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:48:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:48:41 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d3eab-e4c0-4500-8c81-73f6d973edcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:48:41 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7e25d0-8edb-4a98-9a3a-7d51d5412e9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815] added
Aug 16 16:48:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db4899-dba1-4882-9d31-eae7351bd1b6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700f74c-df33-4366-b9c8-ce7d309717f2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYTxFfoK {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYTxFfoK" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc32448-5dcf-492a-9e70-1ddc746bf3b9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WYTxFfoK'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a210003-0c02-45e3-b79f-15591b7aa7c4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb96652-b293-459c-b531-f04db637dcba]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6d72e-80e0-4416-b200-5cf581c1564c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260]
Aug 16 16:48:41 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260] successful.
Aug 16 16:48:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff91091-e463-4e87-a22a-8c803089293b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0a443-fa3e-4c7f-88dd-fe0460d42b8d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:41 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:48:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:41 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:48:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11f18d-2223-4faf-a108-0c7be056d549]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:48:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYTxFfoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26564313762636464', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564313762636464', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1669337065',display_name='tempest-TestVolumeBootPattern-server-1669337065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1669337065',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-hxo0d3n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:15Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=05300534-a2db-4aa6-959e-a9a643064c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'pci_devices' on Instance uuid 05300534-a2db-4aa6-959e-a9a643064c4d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:48:42 user nova-compute[73450]:   <uuid>05300534-a2db-4aa6-959e-a9a643064c4d</uuid>
Aug 16 16:48:42 user nova-compute[73450]:   <name>instance-00000019</name>
Aug 16 16:48:42 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:48:42 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:48:42 user nova-compute[73450]:   <metadata>
Aug 16 16:48:42 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:48:42 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:48:42 user nova-compute[73450]:       <nova:name>tempest-TestVolumeBootPattern-server-1669337065</nova:name>
Aug 16 16:48:42 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:48:41</nova:creationTime>
Aug 16 16:48:42 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:48:42 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:48:42 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:48:42 user nova-compute[73450]:       <nova:owner>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:user uuid="8c95d246b43b45b4963f9d750ae89fbd">tempest-TestVolumeBootPattern-717711848-project-member</nova:user>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:project uuid="a3b953d82d634106aa0fb9574fafdc0d">tempest-TestVolumeBootPattern-717711848</nova:project>
Aug 16 16:48:42 user nova-compute[73450]:       </nova:owner>
Aug 16 16:48:42 user nova-compute[73450]:       <nova:ports>
Aug 16 16:48:42 user nova-compute[73450]:         <nova:port uuid="efbc51fe-58ba-4e8e-887c-04c0ad83a51a">
Aug 16 16:48:42 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 16:48:42 user nova-compute[73450]:         </nova:port>
Aug 16 16:48:42 user nova-compute[73450]:       </nova:ports>
Aug 16 16:48:42 user nova-compute[73450]:     </nova:instance>
Aug 16 16:48:42 user nova-compute[73450]:   </metadata>
Aug 16 16:48:42 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:48:42 user nova-compute[73450]:     <system>
Aug 16 16:48:42 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:48:42 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:48:42 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:48:42 user nova-compute[73450]:       <entry name="serial">05300534-a2db-4aa6-959e-a9a643064c4d</entry>
Aug 16 16:48:42 user nova-compute[73450]:       <entry name="uuid">05300534-a2db-4aa6-959e-a9a643064c4d</entry>
Aug 16 16:48:42 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:48:42 user nova-compute[73450]:     </system>
Aug 16 16:48:42 user nova-compute[73450]:   </sysinfo>
Aug 16 16:48:42 user nova-compute[73450]:   <os>
Aug 16 16:48:42 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:48:42 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:48:42 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:48:42 user nova-compute[73450]:   </os>
Aug 16 16:48:42 user nova-compute[73450]:   <features>
Aug 16 16:48:42 user nova-compute[73450]:     <acpi/>
Aug 16 16:48:42 user nova-compute[73450]:     <apic/>
Aug 16 16:48:42 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:48:42 user nova-compute[73450]:   </features>
Aug 16 16:48:42 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:48:42 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:48:42 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:48:42 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:48:42 user nova-compute[73450]:   </clock>
Aug 16 16:48:42 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:48:42 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:48:42 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:48:42 user nova-compute[73450]:   </cpu>
Aug 16 16:48:42 user nova-compute[73450]:   <devices>
Aug 16 16:48:42 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:48:42 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:48:42 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 16:48:42 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:48:42 user nova-compute[73450]:       <serial>9c87a2a0-9e97-4d1d-a12a-b2cba0196815</serial>
Aug 16 16:48:42 user nova-compute[73450]:     </disk>
Aug 16 16:48:42 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:48:42 user nova-compute[73450]:       <mac address="fa:16:3e:95:9e:3a"/>
Aug 16 16:48:42 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:48:42 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:48:42 user nova-compute[73450]:       <target dev="tapefbc51fe-58"/>
Aug 16 16:48:42 user nova-compute[73450]:     </interface>
Aug 16 16:48:42 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:48:42 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/05300534-a2db-4aa6-959e-a9a643064c4d/console.log" append="off"/>
Aug 16 16:48:42 user nova-compute[73450]:     </serial>
Aug 16 16:48:42 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:48:42 user nova-compute[73450]:     <video>
Aug 16 16:48:42 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:48:42 user nova-compute[73450]:     </video>
Aug 16 16:48:42 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:48:42 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:48:42 user nova-compute[73450]:     </rng>
Aug 16 16:48:42 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:48:42 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:48:42 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:48:42 user nova-compute[73450]:     </memballoon>
Aug 16 16:48:42 user nova-compute[73450]:   </devices>
Aug 16 16:48:42 user nova-compute[73450]: </domain>
Aug 16 16:48:42 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1669337065',display_name='tempest-TestVolumeBootPattern-server-1669337065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1669337065',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-hxo0d3n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:15Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=05300534-a2db-4aa6-959e-a9a643064c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG os_vif [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefbc51fe-58, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefbc51fe-58, col_values=(('external_ids', {'iface-id': 'efbc51fe-58ba-4e8e-887c-04c0ad83a51a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:9e:3a', 'vm-uuid': '05300534-a2db-4aa6-959e-a9a643064c4d'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:48:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:42 user nova-compute[73450]: INFO os_vif [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58')
Aug 16 16:48:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:48:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No VIF found with MAC fa:16:3e:95:9e:3a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:48:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:43 user nova-compute[73450]: INFO nova.compute.manager [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Unshelving
Aug 16 16:48:43 user nova-compute[73450]: INFO nova.virt.block_device [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Booting with volume 4419ccbc-3b15-4d1c-aebe-043a3869e676 at /dev/vdc
Aug 16 16:48:44 user nova-compute[73450]: DEBUG os_brick.utils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d43c4-b326-4d3d-8fe4-633e4f0c8094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c917a57-7f33-41df-b7bb-e66f42e72cc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a67df-f891-45d3-bfe7-2e93de646b37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a246ef7-83b5-42f2-be15-c4f2c5d184e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:44 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:48:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44298b8c-b51f-4d23-96d8-6f6400c6cd13]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG os_brick.utils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating existing volume attachment record: f3faf7ef-cdde-48e9-88a2-0d8bc43286c7 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-463c6020-8789-4fab-964e-59013e205568 req-37d2ca45-67f8-4b99-aa8f-132c9d44864e service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-463c6020-8789-4fab-964e-59013e205568 req-37d2ca45-67f8-4b99-aa8f-132c9d44864e service nova] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-463c6020-8789-4fab-964e-59013e205568 req-37d2ca45-67f8-4b99-aa8f-132c9d44864e service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-463c6020-8789-4fab-964e-59013e205568 req-37d2ca45-67f8-4b99-aa8f-132c9d44864e service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-463c6020-8789-4fab-964e-59013e205568 req-37d2ca45-67f8-4b99-aa8f-132c9d44864e service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] No waiting events found dispatching network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:45 user nova-compute[73450]: WARNING nova.compute.manager [req-463c6020-8789-4fab-964e-59013e205568 req-37d2ca45-67f8-4b99-aa8f-132c9d44864e service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received unexpected event network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a for instance with vm_state building and task_state spawning.
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:48:46 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:48:46 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:48:46 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88df0a5-2566-417a-822f-40d62a62099c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:48:46 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c49910-0082-493a-ac12-7b7fe289e148]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4] added
Aug 16 16:48:46 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aef814e-5f43-462e-993a-8d78f065de18]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[94169e31-5aca-4ad7-8f7f-ec1f54e04323]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdvMbeKc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdvMbeKc" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ea393-c12e-4937-b99e-abb4b7b33247]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wdvMbeKc'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[89475124-a053-46cd-9a38-234cabb0fd8a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e76bda-36d0-4669-bc17-27e9921c301f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:46 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:48:46 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:46 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:48:46 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f39d0-0621-4c3d-af03-5fc7260ddc02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]
Aug 16 16:48:46 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.
Aug 16 16:48:46 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68fb65-3819-40cd-9f34-cd7149dedab7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c5d93-b8ef-40f5-b271-4ac99ac7a685]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:46 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:48:46 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:48:46 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:48:46 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:48:46 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:48:46 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c9ce27-88c3-4e5f-8acb-6332aebd3857]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:48:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204527.0019236, 05300534-a2db-4aa6-959e-a9a643064c4d => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] VM Resumed (Lifecycle Event)
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Instance spawned successfully.
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204527.0020878, 05300534-a2db-4aa6-959e-a9a643064c4d => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] VM Started (Lifecycle Event)
Aug 16 16:48:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:48:47 user nova-compute[73450]: INFO nova.compute.manager [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Took 33.47 seconds to build instance.
Aug 16 16:48:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8b414d76-2bdb-4bab-bbca-9b0960d38bd5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "05300534-a2db-4aa6-959e-a9a643064c4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.586s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-1d1a1aa3-b367-4e93-9e02-32104dfd3074 req-6985aceb-6127-48c8-a803-32bb6db85813 service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1d1a1aa3-b367-4e93-9e02-32104dfd3074 req-6985aceb-6127-48c8-a803-32bb6db85813 service nova] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1d1a1aa3-b367-4e93-9e02-32104dfd3074 req-6985aceb-6127-48c8-a803-32bb6db85813 service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1d1a1aa3-b367-4e93-9e02-32104dfd3074 req-6985aceb-6127-48c8-a803-32bb6db85813 service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-1d1a1aa3-b367-4e93-9e02-32104dfd3074 req-6985aceb-6127-48c8-a803-32bb6db85813 service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] No waiting events found dispatching network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:47 user nova-compute[73450]: WARNING nova.compute.manager [req-1d1a1aa3-b367-4e93-9e02-32104dfd3074 req-6985aceb-6127-48c8-a803-32bb6db85813 service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received unexpected event network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a for instance with vm_state active and task_state None.
Aug 16 16:48:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26565393761656630', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565393761656630', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:48:47 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:48:47 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:48:47 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:48:47 user nova-compute[73450]:   <serial>b31eddbc-5530-48a8-886b-3ae816f6d7f4</serial>
Aug 16 16:48:47 user nova-compute[73450]: </disk>
Aug 16 16:48:47 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:48:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No VIF found with MAC fa:16:3e:64:3d:a7, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2169f3f-0c0a-45c2-be98-3101933afe5f tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.821s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73450) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-92d4db63-03ee-4718-bfab-dac0d2890886 req-f781b7f8-b91e-431e-86fe-49a1458ad37f service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92d4db63-03ee-4718-bfab-dac0d2890886 req-f781b7f8-b91e-431e-86fe-49a1458ad37f service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92d4db63-03ee-4718-bfab-dac0d2890886 req-f781b7f8-b91e-431e-86fe-49a1458ad37f service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92d4db63-03ee-4718-bfab-dac0d2890886 req-f781b7f8-b91e-431e-86fe-49a1458ad37f service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-92d4db63-03ee-4718-bfab-dac0d2890886 req-f781b7f8-b91e-431e-86fe-49a1458ad37f service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:49 user nova-compute[73450]: WARNING nova.compute.manager [req-92d4db63-03ee-4718-bfab-dac0d2890886 req-f781b7f8-b91e-431e-86fe-49a1458ad37f service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state active and task_state powering-off.
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance destroyed successfully.
Aug 16 16:48:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5ef040a6-dd58-4161-a8ff-44ef669b9fbf tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:51 user nova-compute[73450]: WARNING nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state None.
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:51 user nova-compute[73450]: WARNING nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state None.
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:51 user nova-compute[73450]: WARNING nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state None.
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:51 user nova-compute[73450]: WARNING nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state None.
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:48:51 user nova-compute[73450]: WARNING nova.compute.manager [req-a22566e7-051d-4e12-9f27-91d375103801 req-77e1c7c4-34ca-4cef-8387-93aa429191e3 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state None.
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:54 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:54 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7331MB free_disk=24.016162872314453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 05300534-a2db-4aa6-959e-a9a643064c4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 93e6b212-411d-408e-94a2-37a64232f8e5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:48:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:48:55 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:48:55 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:48:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:48:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.898s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-changed-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Refreshing instance network info cache due to event network-changed-584b7d85-9923-49f7-96df-27900e697677. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] Acquiring lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] Acquired lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Refreshing network info cache for port 584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG nova.network.neutron [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updated VIF entry in instance network info cache for port 584b7d85-9923-49f7-96df-27900e697677. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG nova.network.neutron [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updating instance_info_cache with network_info: [{"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1df255c7-a6f2-4c80-93dc-cf6b0f14eaee req-fbfe1c58-ec5a-46ed-98b4-30e1087c5958 service nova] Releasing lock "refresh_cache-2cc75551-2782-41ec-b5dc-07bbd62b2e7d" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG nova.objects.instance [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'flavor' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:48:57 user nova-compute[73450]: INFO nova.compute.manager [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attaching volume 0542ef85-817d-48b8-849c-3ec07c3394af to /dev/vdb
Aug 16 16:48:57 user nova-compute[73450]: DEBUG os_brick.utils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7203d6eb-e742-4d29-8cd4-7907413e5909]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f894e-4cf4-45d2-9b72-7edfe0e6b948]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae67af1-1657-4a5a-aa56-b7ecf426e4e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250c1c6-28de-4cd9-a531-a3bcdc1b4f63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:48:57 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:48:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[796cc347-b57d-4ba7-8dfb-6ca33c0aad5b]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG os_brick.utils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updating existing volume attachment record: 077a276a-e8e0-4bc0-ba94-438112306d66 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:48:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:48:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:48:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:49:00 user nova-compute[73450]: INFO nova.compute.claims [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Claim successful on node user
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.network.neutron [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:49:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.policy [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4efd4d0b693f4473b589a3a7d9459c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47137556b71441ab661873ba6b0d920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:49:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Creating image(s)
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "/opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "/opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.265s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk 1073741824" returned: 0 in 0.057s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'pci_requests' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'numa_topology' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.network.neutron [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Successfully created port: 6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:49:01 user nova-compute[73450]: INFO nova.compute.claims [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Claim successful on node user
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.235s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Cannot resize image /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lazy-loading 'migration_context' on Instance uuid 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Ensure instance console log exists: /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:02 user nova-compute[73450]: INFO nova.compute.manager [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Unrescuing
Aug 16 16:49:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:02 user nova-compute[73450]: INFO nova.network.neutron [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating port c1b77572-0f96-4d2f-958d-238e07b02809 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Successfully updated port: 6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquired lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-changed-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Refreshing instance network info cache due to event network-changed-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] Acquiring lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'flavor' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updating instance_info_cache with network_info: [{"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Releasing lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Instance network_info: |[{"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] Acquired lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.neutron [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Refreshing network info cache for port 6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Start _get_guest_xml network_info=[{"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:49:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7664465',id=27,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7ptsuNRzAOO65/e0A4/fM4s3RwvtGPFJQSTTlSqKHc14yO8ANVo3GBcS8dFz5x522Ig18UOQhA+Cfz8cSnQW5li3ZIBPkrEQANbuvilVGTOn4vXTtMqcQ2kEHFP5uRHw==',key_name='tempest-keypair-1745175962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47137556b71441ab661873ba6b0d920',ramdisk_id='',reservation_id='r-4hldtfbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-852876150',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4efd4d0b693f4473b589a3a7d9459c37',uuid=2a3845e6-2b7f-4305-be33-9d483da2adc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Converting VIF {"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-a59508b3-4045-4311-be9e-4f6392a2f373 req-e7106c8e-fc7e-465a-9ecd-42944aade5aa service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a59508b3-4045-4311-be9e-4f6392a2f373 req-e7106c8e-fc7e-465a-9ecd-42944aade5aa service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a59508b3-4045-4311-be9e-4f6392a2f373 req-e7106c8e-fc7e-465a-9ecd-42944aade5aa service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a59508b3-4045-4311-be9e-4f6392a2f373 req-e7106c8e-fc7e-465a-9ecd-42944aade5aa service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-a59508b3-4045-4311-be9e-4f6392a2f373 req-e7106c8e-fc7e-465a-9ecd-42944aade5aa service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:03 user nova-compute[73450]: WARNING nova.compute.manager [req-a59508b3-4045-4311-be9e-4f6392a2f373 req-e7106c8e-fc7e-465a-9ecd-42944aade5aa service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:49:03 user nova-compute[73450]:   <uuid>2a3845e6-2b7f-4305-be33-9d483da2adc9</uuid>
Aug 16 16:49:03 user nova-compute[73450]:   <name>instance-0000001b</name>
Aug 16 16:49:03 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:49:03 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:49:03 user nova-compute[73450]:   <metadata>
Aug 16 16:49:03 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:49:03 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:49:03 user nova-compute[73450]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585</nova:name>
Aug 16 16:49:03 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:49:03</nova:creationTime>
Aug 16 16:49:03 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:49:03 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:49:03 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:49:03 user nova-compute[73450]:       <nova:owner>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:user uuid="4efd4d0b693f4473b589a3a7d9459c37">tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member</nova:user>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:project uuid="a47137556b71441ab661873ba6b0d920">tempest-TestServerVolumeAttachScenarioOldVersion-852876150</nova:project>
Aug 16 16:49:03 user nova-compute[73450]:       </nova:owner>
Aug 16 16:49:03 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:49:03 user nova-compute[73450]:       <nova:ports>
Aug 16 16:49:03 user nova-compute[73450]:         <nova:port uuid="6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1">
Aug 16 16:49:03 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 16:49:03 user nova-compute[73450]:         </nova:port>
Aug 16 16:49:03 user nova-compute[73450]:       </nova:ports>
Aug 16 16:49:03 user nova-compute[73450]:     </nova:instance>
Aug 16 16:49:03 user nova-compute[73450]:   </metadata>
Aug 16 16:49:03 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:49:03 user nova-compute[73450]:     <system>
Aug 16 16:49:03 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:49:03 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:49:03 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:49:03 user nova-compute[73450]:       <entry name="serial">2a3845e6-2b7f-4305-be33-9d483da2adc9</entry>
Aug 16 16:49:03 user nova-compute[73450]:       <entry name="uuid">2a3845e6-2b7f-4305-be33-9d483da2adc9</entry>
Aug 16 16:49:03 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:49:03 user nova-compute[73450]:     </system>
Aug 16 16:49:03 user nova-compute[73450]:   </sysinfo>
Aug 16 16:49:03 user nova-compute[73450]:   <os>
Aug 16 16:49:03 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:49:03 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:49:03 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:49:03 user nova-compute[73450]:   </os>
Aug 16 16:49:03 user nova-compute[73450]:   <features>
Aug 16 16:49:03 user nova-compute[73450]:     <acpi/>
Aug 16 16:49:03 user nova-compute[73450]:     <apic/>
Aug 16 16:49:03 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:49:03 user nova-compute[73450]:   </features>
Aug 16 16:49:03 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:49:03 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:49:03 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:49:03 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:49:03 user nova-compute[73450]:   </clock>
Aug 16 16:49:03 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:49:03 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:49:03 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:49:03 user nova-compute[73450]:   </cpu>
Aug 16 16:49:03 user nova-compute[73450]:   <devices>
Aug 16 16:49:03 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:49:03 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:49:03 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk"/>
Aug 16 16:49:03 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:49:03 user nova-compute[73450]:     </disk>
Aug 16 16:49:03 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:49:03 user nova-compute[73450]:       <mac address="fa:16:3e:49:bb:7a"/>
Aug 16 16:49:03 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:03 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:49:03 user nova-compute[73450]:       <target dev="tap6aa4a57f-3a"/>
Aug 16 16:49:03 user nova-compute[73450]:     </interface>
Aug 16 16:49:03 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:49:03 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/console.log" append="off"/>
Aug 16 16:49:03 user nova-compute[73450]:     </serial>
Aug 16 16:49:03 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:49:03 user nova-compute[73450]:     <video>
Aug 16 16:49:03 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:03 user nova-compute[73450]:     </video>
Aug 16 16:49:03 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:49:03 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:49:03 user nova-compute[73450]:     </rng>
Aug 16 16:49:03 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:49:03 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:49:03 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:49:03 user nova-compute[73450]:     </memballoon>
Aug 16 16:49:03 user nova-compute[73450]:   </devices>
Aug 16 16:49:03 user nova-compute[73450]: </domain>
Aug 16 16:49:03 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7664465',id=27,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7ptsuNRzAOO65/e0A4/fM4s3RwvtGPFJQSTTlSqKHc14yO8ANVo3GBcS8dFz5x522Ig18UOQhA+Cfz8cSnQW5li3ZIBPkrEQANbuvilVGTOn4vXTtMqcQ2kEHFP5uRHw==',key_name='tempest-keypair-1745175962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47137556b71441ab661873ba6b0d920',ramdisk_id='',reservation_id='r-4hldtfbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-852876150',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4efd4d0b693f4473b589a3a7d9459c37',uuid=2a3845e6-2b7f-4305-be33-9d483da2adc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Converting VIF {"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG os_vif [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aa4a57f-3a, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6aa4a57f-3a, col_values=(('external_ids', {'iface-id': '6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:bb:7a', 'vm-uuid': '2a3845e6-2b7f-4305-be33-9d483da2adc9'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: INFO os_vif [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a')
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] No VIF found with MAC fa:16:3e:49:bb:7a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:49:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updated VIF entry in instance network info cache for port 6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updating instance_info_cache with network_info: [{"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bc6fa8b4-bc35-4be6-aead-1fe6773b3226 req-1b9e4bc2-6930-4cb4-ba66-a4f5d3bbdada service nova] Releasing lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance destroyed successfully.
Aug 16 16:49:04 user nova-compute[73450]: DEBUG nova.network.neutron [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:49:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Creating image(s)
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "6f44f31260eace084a8f9f61218b344f28759828" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "6f44f31260eace084a8f9f61218b344f28759828" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204530.0075674, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:06 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Stopped (Lifecycle Event)
Aug 16 16:49:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing instance network info cache due to event network-changed-c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquiring lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquired lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.network.neutron [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Refreshing network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-76361357-f857-48bb-b7bd-f636e113bce6 req-13f8bfd8-3760-43b6-bdbc-d01154c8da5e service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-76361357-f857-48bb-b7bd-f636e113bce6 req-13f8bfd8-3760-43b6-bdbc-d01154c8da5e service nova] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-76361357-f857-48bb-b7bd-f636e113bce6 req-13f8bfd8-3760-43b6-bdbc-d01154c8da5e service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-76361357-f857-48bb-b7bd-f636e113bce6 req-13f8bfd8-3760-43b6-bdbc-d01154c8da5e service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-76361357-f857-48bb-b7bd-f636e113bce6 req-13f8bfd8-3760-43b6-bdbc-d01154c8da5e service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] No waiting events found dispatching network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:06 user nova-compute[73450]: WARNING nova.compute.manager [req-76361357-f857-48bb-b7bd-f636e113bce6 req-13f8bfd8-3760-43b6-bdbc-d01154c8da5e service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received unexpected event network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 for instance with vm_state building and task_state spawning.
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f3c7393d-7be8-4a0c-9f2d-bdb1bde5ad05 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f3c7393d-7be8-4a0c-9f2d-bdb1bde5ad05 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.part --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.virt.images [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] 7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009 was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.part /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.part /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.converted" returned: 0 in 0.449s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "6f44f31260eace084a8f9f61218b344f28759828" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.185s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 --force-share --output=json" returned: 0 in 0.223s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "6f44f31260eace084a8f9f61218b344f28759828" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "6f44f31260eace084a8f9f61218b344f28759828" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updated VIF entry in instance network info cache for port c1b77572-0f96-4d2f-958d-238e07b02809. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Releasing lock "refresh_cache-93e6b212-411d-408e-94a2-37a64232f8e5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:07 user nova-compute[73450]: WARNING nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:07 user nova-compute[73450]: WARNING nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:07 user nova-compute[73450]: WARNING nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:07 user nova-compute[73450]: WARNING nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:07 user nova-compute[73450]: WARNING nova.compute.manager [req-223312a8-abc4-4a07-acd5-21b5b98623f7 req-edf8c054-6697-4ffd-8d9f-d6d59838bf1a service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828,backing_fmt=raw /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828,backing_fmt=raw /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk 1073741824" returned: 0 in 0.060s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "6f44f31260eace084a8f9f61218b344f28759828" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-0a8d1277-d4fe-492a-b4f8-0ec3c92a1cb9 req-495d3c57-8536-4aa5-a6ca-da8608bcca50 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0a8d1277-d4fe-492a-b4f8-0ec3c92a1cb9 req-495d3c57-8536-4aa5-a6ca-da8608bcca50 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0a8d1277-d4fe-492a-b4f8-0ec3c92a1cb9 req-495d3c57-8536-4aa5-a6ca-da8608bcca50 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0a8d1277-d4fe-492a-b4f8-0ec3c92a1cb9 req-495d3c57-8536-4aa5-a6ca-da8608bcca50 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-0a8d1277-d4fe-492a-b4f8-0ec3c92a1cb9 req-495d3c57-8536-4aa5-a6ca-da8608bcca50 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:07 user nova-compute[73450]: WARNING nova.compute.manager [req-0a8d1277-d4fe-492a-b4f8-0ec3c92a1cb9 req-495d3c57-8536-4aa5-a6ca-da8608bcca50 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'migration_context' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Rebasing disk image.
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e -F raw /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:08 user nova-compute[73450]: DEBUG nova.compute.manager [req-88a1b71f-0e9a-4e57-af64-a9e9235240ba req-01fe5bc6-082e-4101-8cde-fe2ed4e12391 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-88a1b71f-0e9a-4e57-af64-a9e9235240ba req-01fe5bc6-082e-4101-8cde-fe2ed4e12391 service nova] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-88a1b71f-0e9a-4e57-af64-a9e9235240ba req-01fe5bc6-082e-4101-8cde-fe2ed4e12391 service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-88a1b71f-0e9a-4e57-af64-a9e9235240ba req-01fe5bc6-082e-4101-8cde-fe2ed4e12391 service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:08 user nova-compute[73450]: DEBUG nova.compute.manager [req-88a1b71f-0e9a-4e57-af64-a9e9235240ba req-01fe5bc6-082e-4101-8cde-fe2ed4e12391 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] No waiting events found dispatching network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:08 user nova-compute[73450]: WARNING nova.compute.manager [req-88a1b71f-0e9a-4e57-af64-a9e9235240ba req-01fe5bc6-082e-4101-8cde-fe2ed4e12391 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received unexpected event network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 for instance with vm_state building and task_state spawning.
Aug 16 16:49:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-6972a528-9424-4338-bf84-ada86d7c7a93 req-58c21b36-a5d1-44ad-b1ad-4eb8ab853ed1 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6972a528-9424-4338-bf84-ada86d7c7a93 req-58c21b36-a5d1-44ad-b1ad-4eb8ab853ed1 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6972a528-9424-4338-bf84-ada86d7c7a93 req-58c21b36-a5d1-44ad-b1ad-4eb8ab853ed1 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6972a528-9424-4338-bf84-ada86d7c7a93 req-58c21b36-a5d1-44ad-b1ad-4eb8ab853ed1 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-6972a528-9424-4338-bf84-ada86d7c7a93 req-58c21b36-a5d1-44ad-b1ad-4eb8ab853ed1 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:09 user nova-compute[73450]: WARNING nova.compute.manager [req-6972a528-9424-4338-bf84-ada86d7c7a93 req-58c21b36-a5d1-44ad-b1ad-4eb8ab853ed1 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204550.3127325, 2a3845e6-2b7f-4305-be33-9d483da2adc9 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] VM Resumed (Lifecycle Event)
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Instance spawned successfully.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204550.3141944, 2a3845e6-2b7f-4305-be33-9d483da2adc9 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] VM Started (Lifecycle Event)
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f70f848c-68e8-440d-baf5-c94dfa69d591 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 767812ec-7b5d-414e-ae14-a0bb1ccfb13b due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204550.4836, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Resumed (Lifecycle Event)
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Took 9.61 seconds to spawn the instance on the hypervisor.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204550.484563, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Started (Lifecycle Event)
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:10 user nova-compute[73450]: INFO nova.compute.manager [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Took 10.61 seconds to build instance.
Aug 16 16:49:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-520e28fe-8df7-4c02-afc4-4cab6a7121ed tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.749s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e -F raw /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk" returned: 0 in 3.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Ensure instance console log exists: /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Start _get_guest_xml network_info=[{"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e68bdcd00751ce25a1ae3f90e8b35849',container_format='bare',created_at=2023-08-16T16:46:51Z,direct_url=<?>,disk_format='qcow2',id=7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1018494408-shelved',owner='c6dfde9621b946408c11bcf2465a9a3d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T16:46:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'f3faf7ef-cdde-48e9-88a2-0d8bc43286c7', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLGicgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '93e6b212-411d-408e-94a2-37a64232f8e5', 'attached_at': '', 'detached_at': '', 'volume_id': '4419ccbc-3b15-4d1c-aebe-043a3869e676', 'serial': '4419ccbc-3b15-4d1c-aebe-043a3869e676'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:49:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e68bdcd00751ce25a1ae3f90e8b35849',container_format='bare',created_at=2023-08-16T16:46:51Z,direct_url=<?>,disk_format='qcow2',id=7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1018494408-shelved',owner='c6dfde9621b946408c11bcf2465a9a3d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T16:46:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLGicgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:11 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:11 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:11 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178c81c-aa3f-4fac-aff3-1b712d341c98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:49:11 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ed27e7-b1fe-4dcf-b936-38490ff34ce9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676] added
Aug 16 16:49:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddebae5-063f-456c-8071-b8bb9d22091f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:11 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9c7c39-9a21-4a00-a326-b4644745b6c6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLGicgSt {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLGicgSt" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac78c4-60fc-4426-9ca8-2f687d13cce5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bLGicgSt'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cef251-f72a-410c-bc9f-8d08fa3c34ed]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[93081833-4ebb-478c-bac7-ee1a50399d72]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5766064-8dc7-4e79-9d71-809fab7dbad0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260]
Aug 16 16:49:11 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260] successful.
Aug 16 16:49:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67836f4d-f1fd-4d4d-ad87-db5d347c61fa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3b3c5-afce-486a-a705-61520690b266]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a29a13-4e91-4129-af33-238196e3fbc4]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLGicgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26461383336613330', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461383336613330', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.279s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:12 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:12 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[01298aeb-c61b-461b-bc7c-938b14791866]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:49:12 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018494408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018494408',id=19,image_ref='7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1720053238',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-5dj8p0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member',shelved_at='2023-08-16T16:46:55.196364',shelved_host='user',shelved_image_id='7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=93e6b212-411d-408e-94a2-37a64232f8e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc13e95-c171-44f5-878e-8695a4f922f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af] added
Aug 16 16:49:12 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:49:12 user nova-compute[73450]:   <uuid>93e6b212-411d-408e-94a2-37a64232f8e5</uuid>
Aug 16 16:49:12 user nova-compute[73450]:   <name>instance-00000013</name>
Aug 16 16:49:12 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:49:12 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:49:12 user nova-compute[73450]:   <metadata>
Aug 16 16:49:12 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:49:12 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:49:12 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1018494408</nova:name>
Aug 16 16:49:12 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:49:11</nova:creationTime>
Aug 16 16:49:12 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:49:12 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:49:12 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:49:12 user nova-compute[73450]:       <nova:owner>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:user uuid="2ed98f68e9e04991817ddf00c2c3cb0e">tempest-AttachVolumeShelveTestJSON-405972124-project-member</nova:user>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:project uuid="c6dfde9621b946408c11bcf2465a9a3d">tempest-AttachVolumeShelveTestJSON-405972124</nova:project>
Aug 16 16:49:12 user nova-compute[73450]:       </nova:owner>
Aug 16 16:49:12 user nova-compute[73450]:       <nova:root type="image" uuid="7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009"/>
Aug 16 16:49:12 user nova-compute[73450]:       <nova:ports>
Aug 16 16:49:12 user nova-compute[73450]:         <nova:port uuid="c1b77572-0f96-4d2f-958d-238e07b02809">
Aug 16 16:49:12 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:49:12 user nova-compute[73450]:         </nova:port>
Aug 16 16:49:12 user nova-compute[73450]:       </nova:ports>
Aug 16 16:49:12 user nova-compute[73450]:     </nova:instance>
Aug 16 16:49:12 user nova-compute[73450]:   </metadata>
Aug 16 16:49:12 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:49:12 user nova-compute[73450]:     <system>
Aug 16 16:49:12 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:49:12 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:49:12 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:49:12 user nova-compute[73450]:       <entry name="serial">93e6b212-411d-408e-94a2-37a64232f8e5</entry>
Aug 16 16:49:12 user nova-compute[73450]:       <entry name="uuid">93e6b212-411d-408e-94a2-37a64232f8e5</entry>
Aug 16 16:49:12 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:49:12 user nova-compute[73450]:     </system>
Aug 16 16:49:12 user nova-compute[73450]:   </sysinfo>
Aug 16 16:49:12 user nova-compute[73450]:   <os>
Aug 16 16:49:12 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:49:12 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:49:12 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:49:12 user nova-compute[73450]:   </os>
Aug 16 16:49:12 user nova-compute[73450]:   <features>
Aug 16 16:49:12 user nova-compute[73450]:     <acpi/>
Aug 16 16:49:12 user nova-compute[73450]:     <apic/>
Aug 16 16:49:12 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:49:12 user nova-compute[73450]:   </features>
Aug 16 16:49:12 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:49:12 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:49:12 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:49:12 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:49:12 user nova-compute[73450]:   </clock>
Aug 16 16:49:12 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:49:12 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:49:12 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:49:12 user nova-compute[73450]:   </cpu>
Aug 16 16:49:12 user nova-compute[73450]:   <devices>
Aug 16 16:49:12 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:49:12 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:49:12 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk"/>
Aug 16 16:49:12 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:49:12 user nova-compute[73450]:     </disk>
Aug 16 16:49:12 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:49:12 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:49:12 user nova-compute[73450]:       <source dev="/dev/sdd"/>
Aug 16 16:49:12 user nova-compute[73450]:       <target dev="vdc" bus="virtio"/>
Aug 16 16:49:12 user nova-compute[73450]:       <serial>4419ccbc-3b15-4d1c-aebe-043a3869e676</serial>
Aug 16 16:49:12 user nova-compute[73450]:     </disk>
Aug 16 16:49:12 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:49:12 user nova-compute[73450]:       <mac address="fa:16:3e:68:62:ee"/>
Aug 16 16:49:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:12 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:49:12 user nova-compute[73450]:       <target dev="tapc1b77572-0f"/>
Aug 16 16:49:12 user nova-compute[73450]:     </interface>
Aug 16 16:49:12 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:49:12 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/console.log" append="off"/>
Aug 16 16:49:12 user nova-compute[73450]:     </serial>
Aug 16 16:49:12 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:49:12 user nova-compute[73450]:     <video>
Aug 16 16:49:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:12 user nova-compute[73450]:     </video>
Aug 16 16:49:12 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:49:12 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:49:12 user nova-compute[73450]:     </rng>
Aug 16 16:49:12 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:49:12 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:49:12 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:49:12 user nova-compute[73450]:     </memballoon>
Aug 16 16:49:12 user nova-compute[73450]:   </devices>
Aug 16 16:49:12 user nova-compute[73450]: </domain>
Aug 16 16:49:12 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018494408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018494408',id=19,image_ref='7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1720053238',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-5dj8p0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member',shelved_at='2023-08-16T16:46:55.196364',shelved_host='user',shelved_image_id='7cb3fd6c-ee36-4f0e-98e4-9f4d10ede009'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=93e6b212-411d-408e-94a2-37a64232f8e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_vif [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc4da6-b457-466f-ab01-7d397fba04f9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1b77572-0f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1b77572-0f, col_values=(('external_ids', {'iface-id': 'c1b77572-0f96-4d2f-958d-238e07b02809', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:62:ee', 'vm-uuid': '93e6b212-411d-408e-94a2-37a64232f8e5'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7c430-f80d-4435-87a9-f49ab09c855c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUBZfxEO {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:12 user nova-compute[73450]: INFO os_vif [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f')
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUBZfxEO" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[81477877-996f-47b2-9f19-3c592c5cb638]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUBZfxEO'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a265fe-a18a-4cfb-94ea-92835c5a47a2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No VIF found with MAC fa:16:3e:68:62:ee, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e52674e-8227-432e-b42f-8a2c5029e509]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:12 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:12 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:12 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:12 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:12 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:12 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:12 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:12 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac1fb9-719f-4bc4-804e-9c23c7c03f46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]
Aug 16 16:49:12 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.
Aug 16 16:49:12 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7524f261-ce08-4366-ad4f-7615d98cb1db]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d45b3a3-8440-47e0-a30c-fa5d00012704]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:13 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:13 user nova-compute[73450]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:13 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b6d52c-b14e-4957-a973-c4959b5369bd]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:13 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== connect_volume: return (2690ms) {'type': 'block', 'scsi_wwn': '26566376134336339', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566376134336339', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'flavor' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:49:14 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:49:14 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:49:14 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:49:14 user nova-compute[73450]:   <serial>0542ef85-817d-48b8-849c-3ec07c3394af</serial>
Aug 16 16:49:14 user nova-compute[73450]: </disk>
Aug 16 16:49:14 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No VIF found with MAC fa:16:3e:5f:6d:f2, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fa08e239-a786-42b2-ad2f-eb7125cbcc93 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.762s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-58507b62-9237-42db-984f-3f4e35fad7ae req-7c111156-c571-46ca-88c1-b84a5ed3d404 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-58507b62-9237-42db-984f-3f4e35fad7ae req-7c111156-c571-46ca-88c1-b84a5ed3d404 service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-58507b62-9237-42db-984f-3f4e35fad7ae req-7c111156-c571-46ca-88c1-b84a5ed3d404 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-58507b62-9237-42db-984f-3f4e35fad7ae req-7c111156-c571-46ca-88c1-b84a5ed3d404 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-58507b62-9237-42db-984f-3f4e35fad7ae req-7c111156-c571-46ca-88c1-b84a5ed3d404 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:15 user nova-compute[73450]: WARNING nova.compute.manager [req-58507b62-9237-42db-984f-3f4e35fad7ae req-7c111156-c571-46ca-88c1-b84a5ed3d404 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 16:49:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:16 user nova-compute[73450]: INFO nova.compute.manager [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Rebuilding instance
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'flavor' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_requests' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'resources' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'migration_context' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73450) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:17 user nova-compute[73450]: INFO nova.compute.manager [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Attaching volume 3b8e335d-3f46-45c0-b9f9-805287ca26a1 to /dev/vdb
Aug 16 16:49:17 user nova-compute[73450]: DEBUG os_brick.utils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99a600-7424-4522-b9da-c4ccc1e1a0c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303f716-1f25-45d9-abb5-5ce911c94e53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[935978ba-0b5b-464c-a807-3d7952a83ecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c458c2-734a-4661-b0c2-b04beacf8bc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:49:17 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[181932cf-62d2-4868-9b91-1694a68cda12]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG os_brick.utils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating existing volume attachment record: a3ccbb49-e6bb-4a0e-b1d7-54ac0af40234 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-244d0e91-89a5-4754-889f-682414bbb2b6 req-5bf2a663-5ad2-4a0b-b420-2ee9ac74e592 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-244d0e91-89a5-4754-889f-682414bbb2b6 req-5bf2a663-5ad2-4a0b-b420-2ee9ac74e592 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-244d0e91-89a5-4754-889f-682414bbb2b6 req-5bf2a663-5ad2-4a0b-b420-2ee9ac74e592 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-244d0e91-89a5-4754-889f-682414bbb2b6 req-5bf2a663-5ad2-4a0b-b420-2ee9ac74e592 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-244d0e91-89a5-4754-889f-682414bbb2b6 req-5bf2a663-5ad2-4a0b-b420-2ee9ac74e592 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:17 user nova-compute[73450]: WARNING nova.compute.manager [req-244d0e91-89a5-4754-889f-682414bbb2b6 req-5bf2a663-5ad2-4a0b-b420-2ee9ac74e592 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuilding.
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance destroyed successfully.
Aug 16 16:49:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-92459e1f-39c2-4c8a-93fb-d37e2067c9c7 req-30a4078d-02e2-4781-b3cd-0f79b1330696 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92459e1f-39c2-4c8a-93fb-d37e2067c9c7 req-30a4078d-02e2-4781-b3cd-0f79b1330696 service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92459e1f-39c2-4c8a-93fb-d37e2067c9c7 req-30a4078d-02e2-4781-b3cd-0f79b1330696 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-92459e1f-39c2-4c8a-93fb-d37e2067c9c7 req-30a4078d-02e2-4781-b3cd-0f79b1330696 service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-92459e1f-39c2-4c8a-93fb-d37e2067c9c7 req-30a4078d-02e2-4781-b3cd-0f79b1330696 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:17 user nova-compute[73450]: WARNING nova.compute.manager [req-92459e1f-39c2-4c8a-93fb-d37e2067c9c7 req-30a4078d-02e2-4781-b3cd-0f79b1330696 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 16:49:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.compute.manager [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Detaching volume 0542ef85-817d-48b8-849c-3ec07c3394af
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204558.0959363, 93e6b212-411d-408e-94a2-37a64232f8e5 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] VM Resumed (Lifecycle Event)
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance spawned successfully.
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.virt.block_device [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attempting to driver detach volume 0542ef85-817d-48b8-849c-3ec07c3394af from mountpoint /dev/vdb
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Attempting to detach device vdb from instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:49:18 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:49:18 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:49:18 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:49:18 user nova-compute[73450]:   <serial>0542ef85-817d-48b8-849c-3ec07c3394af</serial>
Aug 16 16:49:18 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:49:18 user nova-compute[73450]: </disk>
Aug 16 16:49:18 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204558.1087327, 93e6b212-411d-408e-94a2-37a64232f8e5 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] VM Started (Lifecycle Event)
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully detached device vdb from instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d from the persistent domain config.
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:18 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75923c61-12d8-4179-a129-109a8565955a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ae445-8ca6-44e9-8439-567dcd2a3404]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:18 user nova-compute[73450]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270744f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c82850-4769-4a35-a7f4-913573b439de]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[efafe1eb-dded-4f52-84a0-e16e40ba2262]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37536f73-4672-41a1-b9cc-b1527b6078a4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38144a8-d8bf-4f79-ad30-d70f2bbb1b52]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40024f9-25c5-4d6a-9217-796de40600fd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7cb2df-e7ac-4116-958c-a4d94ebfa6db]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]
Aug 16 16:49:18 user nova-compute[73450]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.
Aug 16 16:49:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f374539-897f-4054-b5eb-2bf775549744]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== disconnect_volume: return (391ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:49:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c44dfc41-2c45-46b7-95a2-0a6b73195137 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 34.865s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:19 user nova-compute[73450]: WARNING nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuilding.
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:19 user nova-compute[73450]: WARNING nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuilding.
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:19 user nova-compute[73450]: WARNING nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuilding.
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:19 user nova-compute[73450]: WARNING nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuilding.
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:19 user nova-compute[73450]: WARNING nova.compute.manager [req-d9d0acc6-4dab-4885-810d-dbecb871ee91 req-99d5f59d-4741-4701-9344-fcf765a2d078 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuilding.
Aug 16 16:49:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance destroyed successfully.
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2063771279',display_name='tempest-ServerActionsTestOtherA-server-777207070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2063771279',id=23,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQmCjEwBWBT/s+RkkCOjc/eGOP9z0w95KzLeTdPqlgCuTZqJVaN5DjiHNfWqPwKgKEuD9tdNOXK1xjbGitp8WqrUfrXMvUumz62835vCPBQJqnwiRELQisWoi404DiWjA==',key_name='tempest-keypair-1009333049',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-nhiu05y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=2cc75551-2782-41ec-b5dc-07bbd62b2e7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap584b7d85-99, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:19 user nova-compute[73450]: INFO os_vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99')
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:19 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c21ebbf-4138-4f55-8e99-5256e962c34e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3851a3-730a-4b9d-a8e6-31c6bd89a3ad]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:19 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:19 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:19 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:19 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:19 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:19 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:19 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:19 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270787640>, {}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Disconnecting from: [] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== disconnect_volume: return (64ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:49:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Deleting instance files /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d_del
Aug 16 16:49:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Deletion of /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d_del complete
Aug 16 16:49:20 user nova-compute[73450]: INFO nova.virt.block_device [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Booting with volume 0542ef85-817d-48b8-849c-3ec07c3394af at /dev/vdb
Aug 16 16:49:20 user nova-compute[73450]: DEBUG os_brick.utils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d0bdb-fe91-4ea0-bebd-31a77487fffb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da93dfe7-160d-419f-8df4-114a5774be90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[392e48c7-ee49-4608-9eab-b9f9d7ea0b27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d913c7d-8503-49ba-8bb2-5d955b08aab7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:49:20 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:49:20 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[87394a0b-ea7c-4abd-b2a7-54d6dc18a7a0]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG os_brick.utils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:20 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updating existing volume attachment record: 1b72ed91-b87f-48f4-bce3-5d60ad2226f6 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:49:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'citXAFJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:30 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:30 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:30 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae51c8e-f4dc-433a-a679-ed99bf0bf7d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:49:30 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdf206e-7150-4a53-83b1-c6cce0f5934e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1] added
Aug 16 16:49:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade4083-3578-4b2a-86c5-45ccccb9711d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[17276210-7c95-40e8-8c06-604cd2558659]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v citXAFJE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v citXAFJE" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e2726-771d-4c13-8818-d31595d294d5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'citXAFJE'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f1458-e5c6-469b-84d4-6cc22c3b81f3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd215ce-2802-46ff-b625-57ff5359ebc1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38c472-3b2d-4dd3-a80b-19a6519ee789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260]
Aug 16 16:49:30 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260] successful.
Aug 16 16:49:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d738d901-ee34-4894-889c-32a379c5932c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e362d83-34e5-47b6-bec7-c8f3b53fcdf7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6300d04c-43f0-41b3-b401-de51e51c9209]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'citXAFJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23162343239346432', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162343239346432', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG nova.objects.instance [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'flavor' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:49:31 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:49:31 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:49:31 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:49:31 user nova-compute[73450]:   <serial>3b8e335d-3f46-45c0-b9f9-805287ca26a1</serial>
Aug 16 16:49:31 user nova-compute[73450]: </disk>
Aug 16 16:49:31 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No VIF found with MAC fa:16:3e:57:6a:da, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-91017caf-22b2-4a2a-a92e-d0fceb99445f tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.267s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204557.8547714, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:32 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] VM Stopped (Lifecycle Event)
Aug 16 16:49:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-64ec22b7-703d-48ae-bbd6-399c85d6bd47 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:32 user nova-compute[73450]: INFO nova.compute.manager [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Rescuing
Aug 16 16:49:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:49:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Creating image(s)
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.209s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk 1073741824" returned: 0 in 0.065s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Cannot resize image /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Ensure instance console log exists: /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Start _get_guest_xml network_info=[{"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '1b72ed91-b87f-48f4-bce3-5d60ad2226f6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cc75551-2782-41ec-b5dc-07bbd62b2e7d', 'attached_at': '', 'detached_at': '', 'volume_id': '0542ef85-817d-48b8-849c-3ec07c3394af', 'serial': '0542ef85-817d-48b8-849c-3ec07c3394af'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:33 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 16:49:33 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:49:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:34 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:34 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:34 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:49:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bc4bdb-5add-4f4e-972f-61a6d8e29354]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:49:34 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7f278a-a336-45fe-9380-2300ec868ede]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af] added
Aug 16 16:49:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09905cf-1b7c-49fa-81fb-d1b375475bb1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2ee7f-a30e-4952-9c99-bcfdc934f87c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUBZfxEO {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUBZfxEO" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e531c-f45c-4143-b8fd-933ac45be251]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUBZfxEO'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9129f8a1-a918-4af3-aefd-6f9f8438c079]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fc713-f351-4309-b366-85a7cf98b873]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-0b2fd8a5-b58b-497f-b9bc-3a0b2d2f96a8 req-0c90ef55-803e-4e52-890a-1b53fd23b36d service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b2fd8a5-b58b-497f-b9bc-3a0b2d2f96a8 req-0c90ef55-803e-4e52-890a-1b53fd23b36d service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b2fd8a5-b58b-497f-b9bc-3a0b2d2f96a8 req-0c90ef55-803e-4e52-890a-1b53fd23b36d service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b2fd8a5-b58b-497f-b9bc-3a0b2d2f96a8 req-0c90ef55-803e-4e52-890a-1b53fd23b36d service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-0b2fd8a5-b58b-497f-b9bc-3a0b2d2f96a8 req-0c90ef55-803e-4e52-890a-1b53fd23b36d service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:34 user nova-compute[73450]: WARNING nova.compute.manager [req-0b2fd8a5-b58b-497f-b9bc-3a0b2d2f96a8 req-0c90ef55-803e-4e52-890a-1b53fd23b36d service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state active and task_state rescuing.
Aug 16 16:49:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[053d23e8-0ef7-4fd7-ae93-33faa24fff55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]
Aug 16 16:49:34 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.
Aug 16 16:49:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca28f9d-43fb-40b2-aff2-b62e6e8c276b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[78efa5a3-beec-4ac0-a672-dde9e7367bea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:34 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c3542b-4430-4dec-a597-5ef4e13645fe]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance destroyed successfully.
Aug 16 16:49:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Attempting a stable device rescue
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73450) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:49:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Creating image(s)
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'trusted_certs' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "f86195247aafbb4019d46a3934ef07d50ca4b783" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "f86195247aafbb4019d46a3934ef07d50ca4b783" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.687s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== connect_volume: return (1689ms) {'type': 'block', 'scsi_wwn': '26566376134336339', 'path': '/dev/sdf'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566376134336339', 'path': '/dev/sdf'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2063771279',display_name='tempest-ServerActionsTestOtherA-server-777207070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2063771279',id=23,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQmCjEwBWBT/s+RkkCOjc/eGOP9z0w95KzLeTdPqlgCuTZqJVaN5DjiHNfWqPwKgKEuD9tdNOXK1xjbGitp8WqrUfrXMvUumz62835vCPBQJqnwiRELQisWoi404DiWjA==',key_name='tempest-keypair-1009333049',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-nhiu05y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=2cc75551-2782-41ec-b5dc-07bbd62b2e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:49:35 user nova-compute[73450]:   <uuid>2cc75551-2782-41ec-b5dc-07bbd62b2e7d</uuid>
Aug 16 16:49:35 user nova-compute[73450]:   <name>instance-00000017</name>
Aug 16 16:49:35 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:49:35 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:49:35 user nova-compute[73450]:   <metadata>
Aug 16 16:49:35 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:49:35 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:49:35 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherA-server-777207070</nova:name>
Aug 16 16:49:35 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:49:33</nova:creationTime>
Aug 16 16:49:35 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:49:35 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:49:35 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:49:35 user nova-compute[73450]:       <nova:owner>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:user uuid="cfb44f7411ad47b18d2c58a1dc6ac074">tempest-ServerActionsTestOtherA-1309270761-project-member</nova:user>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:project uuid="db72f2fe40fe410098164a19683782d4">tempest-ServerActionsTestOtherA-1309270761</nova:project>
Aug 16 16:49:35 user nova-compute[73450]:       </nova:owner>
Aug 16 16:49:35 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:49:35 user nova-compute[73450]:       <nova:ports>
Aug 16 16:49:35 user nova-compute[73450]:         <nova:port uuid="584b7d85-9923-49f7-96df-27900e697677">
Aug 16 16:49:35 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 16:49:35 user nova-compute[73450]:         </nova:port>
Aug 16 16:49:35 user nova-compute[73450]:       </nova:ports>
Aug 16 16:49:35 user nova-compute[73450]:     </nova:instance>
Aug 16 16:49:35 user nova-compute[73450]:   </metadata>
Aug 16 16:49:35 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:49:35 user nova-compute[73450]:     <system>
Aug 16 16:49:35 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:49:35 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:49:35 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:49:35 user nova-compute[73450]:       <entry name="serial">2cc75551-2782-41ec-b5dc-07bbd62b2e7d</entry>
Aug 16 16:49:35 user nova-compute[73450]:       <entry name="uuid">2cc75551-2782-41ec-b5dc-07bbd62b2e7d</entry>
Aug 16 16:49:35 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:49:35 user nova-compute[73450]:     </system>
Aug 16 16:49:35 user nova-compute[73450]:   </sysinfo>
Aug 16 16:49:35 user nova-compute[73450]:   <os>
Aug 16 16:49:35 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:49:35 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:49:35 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:49:35 user nova-compute[73450]:   </os>
Aug 16 16:49:35 user nova-compute[73450]:   <features>
Aug 16 16:49:35 user nova-compute[73450]:     <acpi/>
Aug 16 16:49:35 user nova-compute[73450]:     <apic/>
Aug 16 16:49:35 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:49:35 user nova-compute[73450]:   </features>
Aug 16 16:49:35 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:49:35 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:49:35 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:49:35 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:49:35 user nova-compute[73450]:   </clock>
Aug 16 16:49:35 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:49:35 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:49:35 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:49:35 user nova-compute[73450]:   </cpu>
Aug 16 16:49:35 user nova-compute[73450]:   <devices>
Aug 16 16:49:35 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:49:35 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:49:35 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk"/>
Aug 16 16:49:35 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:49:35 user nova-compute[73450]:     </disk>
Aug 16 16:49:35 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:49:35 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:49:35 user nova-compute[73450]:       <source dev="/dev/sdf"/>
Aug 16 16:49:35 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:49:35 user nova-compute[73450]:       <serial>0542ef85-817d-48b8-849c-3ec07c3394af</serial>
Aug 16 16:49:35 user nova-compute[73450]:     </disk>
Aug 16 16:49:35 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:49:35 user nova-compute[73450]:       <mac address="fa:16:3e:5f:6d:f2"/>
Aug 16 16:49:35 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:35 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:49:35 user nova-compute[73450]:       <target dev="tap584b7d85-99"/>
Aug 16 16:49:35 user nova-compute[73450]:     </interface>
Aug 16 16:49:35 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:49:35 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/console.log" append="off"/>
Aug 16 16:49:35 user nova-compute[73450]:     </serial>
Aug 16 16:49:35 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:49:35 user nova-compute[73450]:     <video>
Aug 16 16:49:35 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:35 user nova-compute[73450]:     </video>
Aug 16 16:49:35 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:49:35 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:49:35 user nova-compute[73450]:     </rng>
Aug 16 16:49:35 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:49:35 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:49:35 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:49:35 user nova-compute[73450]:     </memballoon>
Aug 16 16:49:35 user nova-compute[73450]:   </devices>
Aug 16 16:49:35 user nova-compute[73450]: </domain>
Aug 16 16:49:35 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2063771279',display_name='tempest-ServerActionsTestOtherA-server-777207070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2063771279',id=23,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQmCjEwBWBT/s+RkkCOjc/eGOP9z0w95KzLeTdPqlgCuTZqJVaN5DjiHNfWqPwKgKEuD9tdNOXK1xjbGitp8WqrUfrXMvUumz62835vCPBQJqnwiRELQisWoi404DiWjA==',key_name='tempest-keypair-1009333049',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-nhiu05y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=2cc75551-2782-41ec-b5dc-07bbd62b2e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG os_vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap584b7d85-99, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap584b7d85-99, col_values=(('external_ids', {'iface-id': '584b7d85-9923-49f7-96df-27900e697677', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:6d:f2', 'vm-uuid': '2cc75551-2782-41ec-b5dc-07bbd62b2e7d'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:35 user nova-compute[73450]: INFO os_vif [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99')
Aug 16 16:49:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.part --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.images [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] 97798801-704e-484a-bf3e-d5edfad7da88 was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.part /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No VIF found with MAC fa:16:3e:5f:6d:f2, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.part /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.converted" returned: 0 in 0.467s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b28916a-c036-4f6d-8346-2a3b99e68be7 req-64d20b6c-7cd9-4903-bd1d-e1ec1fde0f73 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b28916a-c036-4f6d-8346-2a3b99e68be7 req-64d20b6c-7cd9-4903-bd1d-e1ec1fde0f73 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b28916a-c036-4f6d-8346-2a3b99e68be7 req-64d20b6c-7cd9-4903-bd1d-e1ec1fde0f73 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b28916a-c036-4f6d-8346-2a3b99e68be7 req-64d20b6c-7cd9-4903-bd1d-e1ec1fde0f73 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b28916a-c036-4f6d-8346-2a3b99e68be7 req-64d20b6c-7cd9-4903-bd1d-e1ec1fde0f73 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:36 user nova-compute[73450]: WARNING nova.compute.manager [req-3b28916a-c036-4f6d-8346-2a3b99e68be7 req-64d20b6c-7cd9-4903-bd1d-e1ec1fde0f73 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state active and task_state rescuing.
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "f86195247aafbb4019d46a3934ef07d50ca4b783" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.857s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "f86195247aafbb4019d46a3934ef07d50ca4b783" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "f86195247aafbb4019d46a3934ef07d50ca4b783" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783 --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783,backing_fmt=raw /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783,backing_fmt=raw /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue" returned: 0 in 0.054s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "f86195247aafbb4019d46a3934ef07d50ca4b783" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'migration_context' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Start _get_guest_xml network_info=[{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "vif_mac": "fa:16:3e:57:6a:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '97798801-704e-484a-bf3e-d5edfad7da88', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'a3ccbb49-e6bb-4a0e-b1d7-54ac0af40234', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'citXAFJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c605c1c9-7033-48a9-8ef8-c1815683bd16', 'attached_at': '', 'detached_at': '', 'volume_id': '3b8e335d-3f46-45c0-b9f9-805287ca26a1', 'serial': '3b8e335d-3f46-45c0-b9f9-805287ca26a1'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'resources' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'numa_topology' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:36 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:36 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'vcpu_model' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'citXAFJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:49:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:49:36 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fcad2d-cda3-414f-8166-f5130818a3e6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = citXAFJE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 16:49:36 user nova-compute[73450]: node.name = iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1
Aug 16 16:49:36 user nova-compute[73450]: node.tpgt = -1
Aug 16 16:49:36 user nova-compute[73450]: node.startup = automatic
Aug 16 16:49:36 user nova-compute[73450]: node.leading_login = No
Aug 16 16:49:36 user nova-compute[73450]: iface.iscsi_ifacename = default
Aug 16 16:49:36 user nova-compute[73450]: iface.net_ifacename = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.ipaddress = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.prefix_len = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.hwaddress = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.transport_name = tcp
Aug 16 16:49:36 user nova-compute[73450]: iface.initiatorname = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.vlan_id = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.vlan_priority = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.vlan_state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.iface_num = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.mtu = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.port = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.bootproto = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.subnet_mask = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.gateway = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_alt_client_id = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_dns = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_learn_iqn = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_vendor_id_state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_vendor_id = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.dhcp_slp_da = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.fragmentation = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.gratuitous_arp = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.incoming_forwarding = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.tos_state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.tos = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.ttl = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.delayed_ack = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.tcp_nagle = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.tcp_wsf_state = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.tcp_wsf = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.tcp_timer_scale = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.tcp_timestamp = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.redirect = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.def_task_mgmt_timeout = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.header_digest = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.data_digest = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.immediate_data = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.initial_r2t = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.data_seq_inorder = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.data_pdu_inorder = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.erl = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.max_receive_data_len = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.first_burst_len = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.max_outstanding_r2t = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.max_burst_len = 0
Aug 16 16:49:36 user nova-compute[73450]: iface.chap_auth = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.bidi_chap = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.strict_login_compliance = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.discovery_auth = <empty>
Aug 16 16:49:36 user nova-compute[73450]: iface.discovery_logout = <empty>
Aug 16 16:49:36 user nova-compute[73450]: node.discovery_address = <empty>
Aug 16 16:49:36 user nova-compute[73450]: node.discovery_port = 0
Aug 16 16:49:36 user nova-compute[73450]: node.discovery_type = static
Aug 16 16:49:36 user nova-compute[73450]: node.session.initial_cmdsn = 0
Aug 16 16:49:36 user nova-compute[73450]: node.session.initial_login_retry_max = 8
Aug 16 16:49:36 user nova-compute[73450]: node.session.xmit_thread_priority = -20
Aug 16 16:49:36 user nova-compute[73450]: node.session.cmds_max = 128
Aug 16 16:49:36 user nova-compute[73450]: node.session.queue_depth = 32
Aug 16 16:49:36 user nova-compute[73450]: node.session.nr_sessions = 1
Aug 16 16:49:36 user nova-compute[73450]: node.session.auth.authmethod = CHAP
Aug 16 16:49:36 user nova-compute[73450]: node.session.auth.username = citXAFJE
Aug 16 16:49:36 user nova-compute[73450]: node.session.auth.password = ***
Aug 16 16:49:36 user nova-compute[73450]: node.session.auth.username_in = <empty>
Aug 16 16:49:36 user nova-compute[73450]: node.session.auth.password_in = <empty>
Aug 16 16:49:36 user nova-compute[73450]: node.session.auth.chap_algs = MD5
Aug 16 16:49:36 user nova-compute[73450]: node.session.timeo.replacement_timeout = 120
Aug 16 16:49:36 user nova-compute[73450]: node.session.err_timeo.abort_timeout = 15
Aug 16 16:49:36 user nova-compute[73450]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 16:49:36 user nova-compute[73450]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 16:49:36 user nova-compute[73450]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.FastAbort = Yes
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.InitialR2T = No
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.ImmediateData = Yes
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.MaxConnections = 1
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 16:49:36 user nova-compute[73450]: node.session.iscsi.ERL = 0
Aug 16 16:49:36 user nova-compute[73450]: node.session.scan = manual
Aug 16 16:49:36 user nova-compute[73450]: node.session.reopen_max = 0
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].address = 172.16.0.220
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].port = 3260
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].startup = manual
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].tcp.window_size = 524288
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].tcp.type_of_service = 0
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].timeo.logout_timeout = 15
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].timeo.login_timeout = 15
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].timeo.auth_timeout = 45
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].iscsi.DataDigest = None
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].iscsi.IFMarker = No
Aug 16 16:49:36 user nova-compute[73450]: node.conn[0].iscsi.OFMarker = No
Aug 16 16:49:36 user nova-compute[73450]: # END RECORD
Aug 16 16:49:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d97dd-d5fc-46f7-8eaf-d8674ecc94a2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9f0383-8303-4ccc-96f8-0f50c6409f6f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v citXAFJE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v citXAFJE" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa89d9a-30de-4be3-8f6b-669f4256ca0d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'citXAFJE'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d1a5b5-f314-416e-9f96-331500d9423e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[91739e9f-f2ec-43b7-bd83-beaf4ed44695]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:37 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:49:37 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:49:37 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] HCTL ('36', '0', '0', 0) found on session 26 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b70a13-8f2b-44ed-af39-76dfb1143955]: (4, ('0 0 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Searching for a device in session 26 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'citXAFJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23162343239346432', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162343239346432', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1187841430',display_name='tempest-ServerStableDeviceRescueTest-server-1187841430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1187841430',id=20,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4/x++wUoGZmru0aCRIEaekAPJ113Jc9WnArIHvJc3ey5w45JjdPec+EH16OHSJYMH1xUS9xeg4BoWRh+aX+sQ48X4gH3th5D0mdpnzZhvyvXYFHyEF1VjknFO445wpOw==',key_name='tempest-keypair-96903892',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2304f2dbd95141d49fcca835b05f3829',ramdisk_id='',reservation_id='r-3ljt4t07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-365323873',owner_user_name='tempest-ServerStableDeviceRescueTest-365323873-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6ccf870c7044548ffe09751440eff1',uuid=c605c1c9-7033-48a9-8ef8-c1815683bd16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "vif_mac": "fa:16:3e:57:6a:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converting VIF {"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "vif_mac": "fa:16:3e:57:6a:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'pci_devices' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:49:37 user nova-compute[73450]:   <uuid>c605c1c9-7033-48a9-8ef8-c1815683bd16</uuid>
Aug 16 16:49:37 user nova-compute[73450]:   <name>instance-00000014</name>
Aug 16 16:49:37 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:49:37 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:49:37 user nova-compute[73450]:   <metadata>
Aug 16 16:49:37 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:49:37 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:49:37 user nova-compute[73450]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1187841430</nova:name>
Aug 16 16:49:37 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:49:36</nova:creationTime>
Aug 16 16:49:37 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:49:37 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:49:37 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:49:37 user nova-compute[73450]:       <nova:owner>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:user uuid="fc6ccf870c7044548ffe09751440eff1">tempest-ServerStableDeviceRescueTest-365323873-project-member</nova:user>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:project uuid="2304f2dbd95141d49fcca835b05f3829">tempest-ServerStableDeviceRescueTest-365323873</nova:project>
Aug 16 16:49:37 user nova-compute[73450]:       </nova:owner>
Aug 16 16:49:37 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:49:37 user nova-compute[73450]:       <nova:ports>
Aug 16 16:49:37 user nova-compute[73450]:         <nova:port uuid="7fbf4a53-062d-4fc5-990a-fcff33353b26">
Aug 16 16:49:37 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 16:49:37 user nova-compute[73450]:         </nova:port>
Aug 16 16:49:37 user nova-compute[73450]:       </nova:ports>
Aug 16 16:49:37 user nova-compute[73450]:     </nova:instance>
Aug 16 16:49:37 user nova-compute[73450]:   </metadata>
Aug 16 16:49:37 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:49:37 user nova-compute[73450]:     <system>
Aug 16 16:49:37 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:49:37 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:49:37 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:49:37 user nova-compute[73450]:       <entry name="serial">c605c1c9-7033-48a9-8ef8-c1815683bd16</entry>
Aug 16 16:49:37 user nova-compute[73450]:       <entry name="uuid">c605c1c9-7033-48a9-8ef8-c1815683bd16</entry>
Aug 16 16:49:37 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:49:37 user nova-compute[73450]:     </system>
Aug 16 16:49:37 user nova-compute[73450]:   </sysinfo>
Aug 16 16:49:37 user nova-compute[73450]:   <os>
Aug 16 16:49:37 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:49:37 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:49:37 user nova-compute[73450]:   </os>
Aug 16 16:49:37 user nova-compute[73450]:   <features>
Aug 16 16:49:37 user nova-compute[73450]:     <acpi/>
Aug 16 16:49:37 user nova-compute[73450]:     <apic/>
Aug 16 16:49:37 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:49:37 user nova-compute[73450]:   </features>
Aug 16 16:49:37 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:49:37 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:49:37 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:49:37 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:49:37 user nova-compute[73450]:   </clock>
Aug 16 16:49:37 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:49:37 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:49:37 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:49:37 user nova-compute[73450]:   </cpu>
Aug 16 16:49:37 user nova-compute[73450]:   <devices>
Aug 16 16:49:37 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:49:37 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:49:37 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk"/>
Aug 16 16:49:37 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:49:37 user nova-compute[73450]:     </disk>
Aug 16 16:49:37 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:49:37 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:49:37 user nova-compute[73450]:       <source dev="/dev/sde"/>
Aug 16 16:49:37 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:49:37 user nova-compute[73450]:       <serial>3b8e335d-3f46-45c0-b9f9-805287ca26a1</serial>
Aug 16 16:49:37 user nova-compute[73450]:     </disk>
Aug 16 16:49:37 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:49:37 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:49:37 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue"/>
Aug 16 16:49:37 user nova-compute[73450]:       <target dev="vdc" bus="virtio"/>
Aug 16 16:49:37 user nova-compute[73450]:       <boot order="1"/>
Aug 16 16:49:37 user nova-compute[73450]:     </disk>
Aug 16 16:49:37 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:49:37 user nova-compute[73450]:       <mac address="fa:16:3e:57:6a:da"/>
Aug 16 16:49:37 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:37 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:49:37 user nova-compute[73450]:       <target dev="tap7fbf4a53-06"/>
Aug 16 16:49:37 user nova-compute[73450]:     </interface>
Aug 16 16:49:37 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:49:37 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/console.log" append="off"/>
Aug 16 16:49:37 user nova-compute[73450]:     </serial>
Aug 16 16:49:37 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:49:37 user nova-compute[73450]:     <video>
Aug 16 16:49:37 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:49:37 user nova-compute[73450]:     </video>
Aug 16 16:49:37 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:49:37 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:49:37 user nova-compute[73450]:     </rng>
Aug 16 16:49:37 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:49:37 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:49:37 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:49:37 user nova-compute[73450]:     </memballoon>
Aug 16 16:49:37 user nova-compute[73450]:   </devices>
Aug 16 16:49:37 user nova-compute[73450]: </domain>
Aug 16 16:49:37 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:49:37 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance destroyed successfully.
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] No VIF found with MAC fa:16:3e:57:6a:da, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:38 user nova-compute[73450]: WARNING nova.compute.manager [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 16:49:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:38 user nova-compute[73450]: WARNING nova.compute.manager [req-10ed8686-6f4f-47cf-8623-3bde39e269ec req-29ae6e61-7a48-482f-9075-8dbfac5e920a service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 16:49:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:40 user nova-compute[73450]: WARNING nova.compute.manager [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state active and task_state rescuing.
Aug 16 16:49:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:49:40 user nova-compute[73450]: WARNING nova.compute.manager [req-507470dc-1716-41ea-ae9c-0dfbb957e2cb req-bf7815dd-e5ae-410b-b74a-245a79008b44 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state active and task_state rescuing.
Aug 16 16:49:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204581.2773767, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] VM Resumed (Lifecycle Event)
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance spawned successfully.
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204581.2789145, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] VM Started (Lifecycle Event)
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73450) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-702780a9-0720-457f-8279-2c58408d8084 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for c605c1c9-7033-48a9-8ef8-c1815683bd16 due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204581.6721833, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Resumed (Lifecycle Event)
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a5778e1c-d10b-4290-9081-3b3144017e16 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204581.6737258, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:49:41 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Started (Lifecycle Event)
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:49:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:49:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:45 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:49:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:49:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:49:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:49:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7009MB free_disk=23.87989044189453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 05300534-a2db-4aa6-959e-a9a643064c4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 93e6b212-411d-408e-94a2-37a64232f8e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 16:49:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.006s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 16:49:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:49:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG nova.compute.manager [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-changed-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG nova.compute.manager [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Refreshing instance network info cache due to event network-changed-d20f08f0-eaf2-4455-a575-cc94e95e549a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] Acquiring lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] Acquired lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Refreshing network info cache for port d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "05300534-a2db-4aa6-959e-a9a643064c4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:04 user nova-compute[73450]: INFO nova.compute.manager [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Terminating instance
Aug 16 16:50:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.network.neutron [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updated VIF entry in instance network info cache for port d20f08f0-eaf2-4455-a575-cc94e95e549a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.network.neutron [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating instance_info_cache with network_info: [{"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-63f0fe60-b3f5-45d7-b1a6-6e4580f3e78a req-62df6dbb-bebf-4cf6-bbdd-3293a07e5c7d service nova] Releasing lock "refresh_cache-0340c20a-c2c8-409f-bd43-0a91880f8f87" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-ec78748a-1d4b-4b74-8737-dc415509100c req-5fa5a5bc-3195-4089-a50a-a16d275eda53 service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-vif-unplugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ec78748a-1d4b-4b74-8737-dc415509100c req-5fa5a5bc-3195-4089-a50a-a16d275eda53 service nova] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ec78748a-1d4b-4b74-8737-dc415509100c req-5fa5a5bc-3195-4089-a50a-a16d275eda53 service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ec78748a-1d4b-4b74-8737-dc415509100c req-5fa5a5bc-3195-4089-a50a-a16d275eda53 service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-ec78748a-1d4b-4b74-8737-dc415509100c req-5fa5a5bc-3195-4089-a50a-a16d275eda53 service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] No waiting events found dispatching network-vif-unplugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-ec78748a-1d4b-4b74-8737-dc415509100c req-5fa5a5bc-3195-4089-a50a-a16d275eda53 service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-vif-unplugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:50:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Instance destroyed successfully.
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.objects.instance [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'resources' on Instance uuid 05300534-a2db-4aa6-959e-a9a643064c4d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1669337065',display_name='tempest-TestVolumeBootPattern-server-1669337065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1669337065',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-hxo0d3n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:48:47Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=05300534-a2db-4aa6-959e-a9a643064c4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "address": "fa:16:3e:95:9e:3a", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefbc51fe-58", "ovs_interfaceid": "efbc51fe-58ba-4e8e-887c-04c0ad83a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_vif [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefbc51fe-58, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:05 user nova-compute[73450]: INFO os_vif [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:3a,bridge_name='br-int',has_traffic_filtering=True,id=efbc51fe-58ba-4e8e-887c-04c0ad83a51a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefbc51fe-58')
Aug 16 16:50:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYTxFfoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3781b41d-5a5d-40e3-8ecc-22bc98bd19e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e544998-3367-4fae-83a4-2cdf017525fa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:05 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2701f2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82c88c-03d0-4b89-a7f3-32a1d987dfe3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa0a8b-b747-4eec-9901-5e8e32f024d4]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[251b425f-6ee0-41ff-9412-6e3738ffe3c7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:50:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30150eae-7c31-4565-b418-e5ee123f1ed2]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26564313762636464', '/dev/disk/by-id/scsi-1SCST_BIO78168224-ed17bcdd8ca98f17', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_78168224') {{(pid=84237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[becaacff-706b-4017-b78b-592610543dc8]: (4, None) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8133665-1e7f-4a1f-b615-7cd5cc813a71]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[471ce7c2-5438-434b-acdd-a78487a57a74]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260]
Aug 16 16:50:06 user nova-compute[73450]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815, portal: 172.16.0.220,3260] successful.
Aug 16 16:50:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c87a2a0-9e97-4d1d-a12a-b2cba0196815 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c52a39-1cfe-4498-b752-852a80bb403e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== disconnect_volume: return (368ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:50:06 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Deleting instance files /opt/stack/data/nova/instances/05300534-a2db-4aa6-959e-a9a643064c4d_del
Aug 16 16:50:06 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Deletion of /opt/stack/data/nova/instances/05300534-a2db-4aa6-959e-a9a643064c4d_del complete
Aug 16 16:50:06 user nova-compute[73450]: INFO nova.compute.manager [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 16 16:50:06 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:50:06 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:50:06 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Took 0.53 seconds to deallocate network for instance.
Aug 16 16:50:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] Acquiring lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] Lock "05300534-a2db-4aa6-959e-a9a643064c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] No waiting events found dispatching network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:50:07 user nova-compute[73450]: WARNING nova.compute.manager [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received unexpected event network-vif-plugged-efbc51fe-58ba-4e8e-887c-04c0ad83a51a for instance with vm_state active and task_state deleting.
Aug 16 16:50:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-0f5f9213-5f16-437d-997a-99444978da5a req-2b21efdb-c989-4b8b-b7a2-460beaf4dadb service nova] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Received event network-vif-deleted-efbc51fe-58ba-4e8e-887c-04c0ad83a51a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:07 user nova-compute[73450]: INFO nova.compute.manager [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Took 0.82 seconds to detach 1 volumes for instance.
Aug 16 16:50:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Deleting volume: 9c87a2a0-9e97-4d1d-a12a-b2cba0196815 {{(pid=73450) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 16:50:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:08 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:50:08 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:50:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:08 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Deleted allocations for instance 05300534-a2db-4aa6-959e-a9a643064c4d
Aug 16 16:50:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-eb5c4fbe-0ae1-433c-9b0f-a428dea351e4 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "05300534-a2db-4aa6-959e-a9a643064c4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.293s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:10 user nova-compute[73450]: INFO nova.compute.manager [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attaching volume 9454c670-1040-4b24-b7e8-1ce08d741121 to /dev/vdb
Aug 16 16:50:10 user nova-compute[73450]: DEBUG os_brick.utils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56204a-455d-4ce6-8dba-c87dae5167cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a36eb-f6fd-4fa9-b316-9affec20741d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c047c-6604-4f53-9cfb-3f8df5a9e858]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f6343c-c7b5-4339-abaa-5565cbc886b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:50:10 user nova-compute[73450]: INFO nova.compute.manager [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] instance snapshotting
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:50:10 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04e6d69-c5c8-4615-8e07-c31c7187435d]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG os_brick.utils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating existing volume attachment record: 7a4be57c-4ad8-4c6c-a445-80d24e00d3ca {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:50:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Beginning live snapshot process
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpio3bl19a/2edb514287574ed6b7629795b17a37a4.delta 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpio3bl19a/2edb514287574ed6b7629795b17a37a4.delta 1073741824" returned: 0 in 0.080s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 16:50:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:50:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:50:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 16:50:12 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:50:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpio3bl19a/2edb514287574ed6b7629795b17a37a4.delta /opt/stack/data/nova/instances/snapshots/tmpio3bl19a/2edb514287574ed6b7629795b17a37a4 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpio3bl19a/2edb514287574ed6b7629795b17a37a4.delta /opt/stack/data/nova/instances/snapshots/tmpio3bl19a/2edb514287574ed6b7629795b17a37a4" returned: 0 in 0.602s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:13 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Snapshot extracted, beginning image upload
Aug 16 16:50:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Snapshot image upload complete
Aug 16 16:50:16 user nova-compute[73450]: INFO nova.compute.manager [None req-6b8d7622-62e4-41aa-91b2-da658c2567a1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Took 5.87 seconds to snapshot the instance on the hypervisor.
Aug 16 16:50:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:20 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204605.7381878, 05300534-a2db-4aa6-959e-a9a643064c4d => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:50:20 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] VM Stopped (Lifecycle Event)
Aug 16 16:50:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-44487226-5954-4a51-9501-77a0842dbc84 None None] [instance: 05300534-a2db-4aa6-959e-a9a643064c4d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:50:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yICENkSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:22 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:22 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:22 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdec522e-b7f5-4393-bbbd-ef7e223290d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:50:22 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6839c-bb5e-49fe-b560-2e855a36d3f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121] added
Aug 16 16:50:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[19124827-d4e9-4fc6-b5b5-e7b01a09da81]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d96b693-b210-4316-9f8e-b8a387716da2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yICENkSj {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yICENkSj" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6eb69-dd22-432e-852d-ed886bc2432e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yICENkSj'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1efa3-faa8-44f9-916e-54796465a1a4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[915f0872-452f-4aad-9780-c665e682599d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[201851e3-a8e2-485c-955b-4831c8ef03b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260]
Aug 16 16:50:22 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260] successful.
Aug 16 16:50:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ee929-1c34-4230-8413-c7640cba63d8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[132bef39-61c1-4311-9048-065f56fce173]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:22 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:22 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa35b26-aa95-4f30-8893-21d5eed9935a]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:22 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yICENkSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23432306464313736', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432306464313736', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:50:23 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:50:23 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:50:23 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:50:23 user nova-compute[73450]:   <serial>9454c670-1040-4b24-b7e8-1ce08d741121</serial>
Aug 16 16:50:23 user nova-compute[73450]: </disk>
Aug 16 16:50:23 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No VIF found with MAC fa:16:3e:60:ff:4b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:50:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c66729e7-e405-4460-8d57-e907848e48ba tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.752s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:34 user nova-compute[73450]: INFO nova.compute.manager [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Detaching volume 4419ccbc-3b15-4d1c-aebe-043a3869e676
Aug 16 16:50:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:34 user nova-compute[73450]: INFO nova.virt.block_device [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Attempting to driver detach volume 4419ccbc-3b15-4d1c-aebe-043a3869e676 from mountpoint /dev/vdc
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Attempting to detach device vdc from instance 93e6b212-411d-408e-94a2-37a64232f8e5 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:50:34 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:50:34 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:50:34 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:50:34 user nova-compute[73450]:   <serial>4419ccbc-3b15-4d1c-aebe-043a3869e676</serial>
Aug 16 16:50:34 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:50:34 user nova-compute[73450]: </disk>
Aug 16 16:50:34 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:50:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully detached device vdc from instance 93e6b212-411d-408e-94a2-37a64232f8e5 from the persistent domain config.
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 93e6b212-411d-408e-94a2-37a64232f8e5 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:50:34 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:50:34 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:50:34 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:50:34 user nova-compute[73450]:   <serial>4419ccbc-3b15-4d1c-aebe-043a3869e676</serial>
Aug 16 16:50:34 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:50:34 user nova-compute[73450]: </disk>
Aug 16 16:50:34 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204634.9405487, 93e6b212-411d-408e-94a2-37a64232f8e5 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:50:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully detached device vdc from instance 93e6b212-411d-408e-94a2-37a64232f8e5 from the live domain config.
Aug 16 16:50:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLGicgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:34 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7eca7-d4e1-4c21-a88d-a7ddca01ed63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4620d-1185-45c7-92ea-418f3ff1af2f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:35 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:35 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe27010ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77728c5d-6f90-41d7-b03c-4c8a9fab6750]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d952f22-3187-4098-9d71-7e4351cc2cf3]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c01746-5fa1-4132-ad9d-0af001f451a0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0772ed-9a4c-44ec-8f44-6ce9a3e4e8bd]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[790bdf44-a4fd-436b-8470-02c3a0fa50e9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed2e5d-1898-42dc-8dbb-34fa93d18db4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260]
Aug 16 16:50:35 user nova-compute[73450]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676, portal: 172.16.0.220,3260] successful.
Aug 16 16:50:35 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4419ccbc-3b15-4d1c-aebe-043a3869e676 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba9c32c-2e15-474b-9da7-da3997438941]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] <== disconnect_volume: return (305ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:50:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'flavor' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7dc105d6-75df-4690-9bfa-865fb1ac9b30 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.742s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:40 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:50:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquired lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:50:40 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:50:40 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'info_cache' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating instance_info_cache with network_info: [{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Releasing lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:50:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance destroyed successfully.
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'resources' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a62f6e8-e0, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:50:41 user nova-compute[73450]: INFO os_vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0')
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[11379279-8663-4650-9330-f7a79904837b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c956671-ba79-4c31-85d3-bc43699a83b7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2702b4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9ac0cc-bb73-4b15-a754-6b6d7ddcae02]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5091d96-e951-4729-814c-a3c6fe8654e5]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047c23f-6b31-4dca-a57e-90f9fa082138]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b16652d-a636-4ef1-a98a-be1c58483845]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[468afbb0-3142-4ab5-87cf-12a836ccc10f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d737775c-2081-4b7a-ba2a-6981b19b3e1a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]
Aug 16 16:50:41 user nova-compute[73450]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.
Aug 16 16:50:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f074ac1b-732d-4709-b162-f85c6dacab58]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== disconnect_volume: return (279ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start _get_guest_xml network_info=[{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '71619342-ccfe-443e-9fde-7215d74de685', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b1ab59d8-8633-4be5-9fa5-d74e7c34df66', 'attached_at': '', 'detached_at': '', 'volume_id': 'b31eddbc-5530-48a8-886b-3ae816f6d7f4', 'serial': 'b31eddbc-5530-48a8-886b-3ae816f6d7f4'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'numa_topology' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:50:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:41 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[406dd49c-248d-48d0-8ea0-e8100cfbce48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:50:41 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4facf0-fa67-4735-8ba7-b00fe0bb27bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4] added
Aug 16 16:50:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f528de9-534d-4813-b305-ca7d563f3368]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e778a7-a99e-4514-a2b2-3aec46866ba8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdvMbeKc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdvMbeKc" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e91dc7-8d2f-4e96-8814-da93a1e262bc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wdvMbeKc'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e3922a-d39c-420a-a37e-142deb45e68c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d2cb44-b407-4bc0-a2cf-085ef1d8d9ae]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:41 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b5d0c-b4b9-4dd0-a53f-93ba1eb242f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]
Aug 16 16:50:42 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.
Aug 16 16:50:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd317665-faf2-44a2-922d-623f625049c6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d7fbb-f4f2-4cd1-ad5c-9b539bb72e14]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:42 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f90b9a-f05d-4761-ae56-12033032f726]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:50:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26565393761656630', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565393761656630', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:50:43 user nova-compute[73450]:   <uuid>b1ab59d8-8633-4be5-9fa5-d74e7c34df66</uuid>
Aug 16 16:50:43 user nova-compute[73450]:   <name>instance-00000016</name>
Aug 16 16:50:43 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:50:43 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:50:43 user nova-compute[73450]:   <metadata>
Aug 16 16:50:43 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:50:43 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:50:43 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeTestJSON-server-1851611719</nova:name>
Aug 16 16:50:43 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:50:41</nova:creationTime>
Aug 16 16:50:43 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:50:43 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:50:43 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:50:43 user nova-compute[73450]:       <nova:owner>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:user uuid="ba47a29f14cc441e826c9af67f20c96a">tempest-AttachVolumeTestJSON-570659826-project-member</nova:user>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:project uuid="d1acac15e03f4d6188cb3517a7901da4">tempest-AttachVolumeTestJSON-570659826</nova:project>
Aug 16 16:50:43 user nova-compute[73450]:       </nova:owner>
Aug 16 16:50:43 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:50:43 user nova-compute[73450]:       <nova:ports>
Aug 16 16:50:43 user nova-compute[73450]:         <nova:port uuid="4a62f6e8-e050-4dae-90ee-7b0724310e90">
Aug 16 16:50:43 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:50:43 user nova-compute[73450]:         </nova:port>
Aug 16 16:50:43 user nova-compute[73450]:       </nova:ports>
Aug 16 16:50:43 user nova-compute[73450]:     </nova:instance>
Aug 16 16:50:43 user nova-compute[73450]:   </metadata>
Aug 16 16:50:43 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:50:43 user nova-compute[73450]:     <system>
Aug 16 16:50:43 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:50:43 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:50:43 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:50:43 user nova-compute[73450]:       <entry name="serial">b1ab59d8-8633-4be5-9fa5-d74e7c34df66</entry>
Aug 16 16:50:43 user nova-compute[73450]:       <entry name="uuid">b1ab59d8-8633-4be5-9fa5-d74e7c34df66</entry>
Aug 16 16:50:43 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:50:43 user nova-compute[73450]:     </system>
Aug 16 16:50:43 user nova-compute[73450]:   </sysinfo>
Aug 16 16:50:43 user nova-compute[73450]:   <os>
Aug 16 16:50:43 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:50:43 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:50:43 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:50:43 user nova-compute[73450]:   </os>
Aug 16 16:50:43 user nova-compute[73450]:   <features>
Aug 16 16:50:43 user nova-compute[73450]:     <acpi/>
Aug 16 16:50:43 user nova-compute[73450]:     <apic/>
Aug 16 16:50:43 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:50:43 user nova-compute[73450]:   </features>
Aug 16 16:50:43 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:50:43 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:50:43 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:50:43 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:50:43 user nova-compute[73450]:   </clock>
Aug 16 16:50:43 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:50:43 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:50:43 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:50:43 user nova-compute[73450]:   </cpu>
Aug 16 16:50:43 user nova-compute[73450]:   <devices>
Aug 16 16:50:43 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:50:43 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:50:43 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk"/>
Aug 16 16:50:43 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:50:43 user nova-compute[73450]:     </disk>
Aug 16 16:50:43 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:50:43 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:50:43 user nova-compute[73450]:       <source dev="/dev/sdc"/>
Aug 16 16:50:43 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:50:43 user nova-compute[73450]:       <serial>b31eddbc-5530-48a8-886b-3ae816f6d7f4</serial>
Aug 16 16:50:43 user nova-compute[73450]:     </disk>
Aug 16 16:50:43 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:50:43 user nova-compute[73450]:       <mac address="fa:16:3e:64:3d:a7"/>
Aug 16 16:50:43 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:50:43 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:50:43 user nova-compute[73450]:       <target dev="tap4a62f6e8-e0"/>
Aug 16 16:50:43 user nova-compute[73450]:     </interface>
Aug 16 16:50:43 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:50:43 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/console.log" append="off"/>
Aug 16 16:50:43 user nova-compute[73450]:     </serial>
Aug 16 16:50:43 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:50:43 user nova-compute[73450]:     <video>
Aug 16 16:50:43 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:50:43 user nova-compute[73450]:     </video>
Aug 16 16:50:43 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:50:43 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:50:43 user nova-compute[73450]:     </rng>
Aug 16 16:50:43 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:50:43 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:50:43 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:50:43 user nova-compute[73450]:     </memballoon>
Aug 16 16:50:43 user nova-compute[73450]:   </devices>
Aug 16 16:50:43 user nova-compute[73450]: </domain>
Aug 16 16:50:43 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.233s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:50:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'migration_context' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG os_vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a62f6e8-e0, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a62f6e8-e0, col_values=(('external_ids', {'iface-id': '4a62f6e8-e050-4dae-90ee-7b0724310e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:3d:a7', 'vm-uuid': 'b1ab59d8-8633-4be5-9fa5-d74e7c34df66'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:44 user nova-compute[73450]: INFO os_vif [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0')
Aug 16 16:50:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-5e477c1d-56f5-4312-b29e-7f1e4660b3cc req-3de6488c-ac21-4e23-9e6e-5dbfa04437e8 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5e477c1d-56f5-4312-b29e-7f1e4660b3cc req-3de6488c-ac21-4e23-9e6e-5dbfa04437e8 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5e477c1d-56f5-4312-b29e-7f1e4660b3cc req-3de6488c-ac21-4e23-9e6e-5dbfa04437e8 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5e477c1d-56f5-4312-b29e-7f1e4660b3cc req-3de6488c-ac21-4e23-9e6e-5dbfa04437e8 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-5e477c1d-56f5-4312-b29e-7f1e4660b3cc req-3de6488c-ac21-4e23-9e6e-5dbfa04437e8 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:50:45 user nova-compute[73450]: WARNING nova.compute.manager [req-5e477c1d-56f5-4312-b29e-7f1e4660b3cc req-3de6488c-ac21-4e23-9e6e-5dbfa04437e8 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state powering-on.
Aug 16 16:50:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204647.788947, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:50:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Resumed (Lifecycle Event)
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:50:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance rebooted successfully.
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b18b93fe-9b12-4e65-be78-c5c369b45b43 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:50:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204647.7904928, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:50:47 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Started (Lifecycle Event)
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-dcde4dc4-a45b-4fd9-94d6-5a25cd847dbe req-f1fb90c8-a17d-4bc1-bb68-5b1f475a47f4 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dcde4dc4-a45b-4fd9-94d6-5a25cd847dbe req-f1fb90c8-a17d-4bc1-bb68-5b1f475a47f4 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dcde4dc4-a45b-4fd9-94d6-5a25cd847dbe req-f1fb90c8-a17d-4bc1-bb68-5b1f475a47f4 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dcde4dc4-a45b-4fd9-94d6-5a25cd847dbe req-f1fb90c8-a17d-4bc1-bb68-5b1f475a47f4 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-dcde4dc4-a45b-4fd9-94d6-5a25cd847dbe req-f1fb90c8-a17d-4bc1-bb68-5b1f475a47f4 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:50:47 user nova-compute[73450]: WARNING nova.compute.manager [req-dcde4dc4-a45b-4fd9-94d6-5a25cd847dbe req-f1fb90c8-a17d-4bc1-bb68-5b1f475a47f4 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state active and task_state None.
Aug 16 16:50:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-changed-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Refreshing instance network info cache due to event network-changed-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] Acquiring lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] Acquired lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG nova.network.neutron [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Refreshing network info cache for port 6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG nova.network.neutron [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updated VIF entry in instance network info cache for port 6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG nova.network.neutron [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updating instance_info_cache with network_info: [{"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ed34d466-f5b8-4047-9acb-2ce26a4036d8 req-401535a4-9a45-4383-a7c7-628e0409cdab service nova] Releasing lock "refresh_cache-2a3845e6-2b7f-4305-be33-9d483da2adc9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:50:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:54 user nova-compute[73450]: INFO nova.compute.manager [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Detaching volume 9454c670-1040-4b24-b7e8-1ce08d741121
Aug 16 16:50:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:54 user nova-compute[73450]: INFO nova.virt.block_device [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attempting to driver detach volume 9454c670-1040-4b24-b7e8-1ce08d741121 from mountpoint /dev/vdb
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Attempting to detach device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:50:54 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:50:54 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:50:54 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:50:54 user nova-compute[73450]:   <serial>9454c670-1040-4b24-b7e8-1ce08d741121</serial>
Aug 16 16:50:54 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:50:54 user nova-compute[73450]: </disk>
Aug 16 16:50:54 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config.
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:50:54 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:50:54 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:50:54 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:50:54 user nova-compute[73450]:   <serial>9454c670-1040-4b24-b7e8-1ce08d741121</serial>
Aug 16 16:50:54 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:50:54 user nova-compute[73450]: </disk>
Aug 16 16:50:54 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204654.6430593, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:50:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config.
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yICENkSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:54 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff97d221-8597-4579-95aa-64cf806c073e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6cf67-358b-4948-b7d5-30a7ce605fb6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 (non-flash)
Aug 16 16:50:54 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:50:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2701f1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a12a4-1c8c-4f80-8c3f-e44b1d60ad14]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed59175-4ae7-496f-97dc-f8ee0646f324]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b9adb-1fc1-48de-9a6f-d9a660ecfeac]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a99947-5fee-4f50-9b2d-9947dc54543b]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d8307-c2a8-4b5a-939f-5e4f45d33552]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d25ca8-9679-425c-b26f-550bcf23afbe]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260]
Aug 16 16:50:54 user nova-compute[73450]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121, portal: 172.16.0.220,3260] successful.
Aug 16 16:50:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9454c670-1040-4b24-b7e8-1ce08d741121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee6973-bbab-4d15-ac65-db41454eb3ee]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== disconnect_volume: return (357ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:50:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7101MB free_disk=23.790340423583984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 93e6b212-411d-408e-94a2-37a64232f8e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:50:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-831ffd95-1528-4f6c-87e2-1646f5ec5709 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.554s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lazy-loading 'flavor' on Instance uuid 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:50:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:50:57 user nova-compute[73450]: INFO nova.compute.manager [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Attaching volume bb37af09-5f21-45c1-a36d-b8fedba87bb0 to /dev/vdb
Aug 16 16:50:57 user nova-compute[73450]: DEBUG os_brick.utils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea3ef4-0763-47c1-845c-a23af78ddae6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c76487a-82e4-4afa-b540-cccf3bea368a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[161a0ea3-cf68-478c-9028-2be9804ad39e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c394014-94e6-4d6c-ab2a-7adbed592482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:50:57 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:50:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c9b63c-cdff-4211-98ad-95e5a9ec0275]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG os_brick.utils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:50:57 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updating existing volume attachment record: e11a16db-224e-4be7-9259-9085df60d3a7 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:50:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:50:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:51:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:00 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:51:00 user nova-compute[73450]: INFO nova.compute.claims [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Claim successful on node user
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:51:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.policy [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d604d793314808984e92afdc5f5da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad178c8525774ad2a342015b9dc1fbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:51:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Creating image(s)
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.217s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk 1073741824" returned: 0 in 0.063s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Successfully created port: ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Cannot resize image /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'migration_context' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Ensure instance console log exists: /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Successfully updated port: ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-changed-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing instance network info cache due to event network-changed-ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance network_info: |[{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.neutron [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing network info cache for port ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Start _get_guest_xml network_info=[{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:51:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-647448038',display_name='tempest-ServerRescueNegativeTestJSON-server-647448038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-647448038',id=28,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2lPh+HhM95TmGjXtvq4sutCHienP7AN5IgBpAy70Fwg/Whw0zVT1E7Tvo4JJvJKWkP5YREamZypxNg6rziWDDI5tJYQsQ75h3ZvKL2TXkkkA7726wwup2qEHkGy+SAYQ==',key_name='tempest-keypair-1753196274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-bx0iht3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d604d793314808984e92afdc5f5da0',uuid=a36f0a56-ed4a-4593-8c78-f71a53938fec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'pci_devices' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:51:03 user nova-compute[73450]:   <uuid>a36f0a56-ed4a-4593-8c78-f71a53938fec</uuid>
Aug 16 16:51:03 user nova-compute[73450]:   <name>instance-0000001c</name>
Aug 16 16:51:03 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:51:03 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:51:03 user nova-compute[73450]:   <metadata>
Aug 16 16:51:03 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:51:03 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:51:03 user nova-compute[73450]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-647448038</nova:name>
Aug 16 16:51:03 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:51:03</nova:creationTime>
Aug 16 16:51:03 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:51:03 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:51:03 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:51:03 user nova-compute[73450]:       <nova:owner>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:user uuid="19d604d793314808984e92afdc5f5da0">tempest-ServerRescueNegativeTestJSON-976614040-project-member</nova:user>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:project uuid="ad178c8525774ad2a342015b9dc1fbf2">tempest-ServerRescueNegativeTestJSON-976614040</nova:project>
Aug 16 16:51:03 user nova-compute[73450]:       </nova:owner>
Aug 16 16:51:03 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:51:03 user nova-compute[73450]:       <nova:ports>
Aug 16 16:51:03 user nova-compute[73450]:         <nova:port uuid="ceda7838-2709-4eec-be04-e29e1127982b">
Aug 16 16:51:03 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 16:51:03 user nova-compute[73450]:         </nova:port>
Aug 16 16:51:03 user nova-compute[73450]:       </nova:ports>
Aug 16 16:51:03 user nova-compute[73450]:     </nova:instance>
Aug 16 16:51:03 user nova-compute[73450]:   </metadata>
Aug 16 16:51:03 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:51:03 user nova-compute[73450]:     <system>
Aug 16 16:51:03 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:51:03 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:51:03 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:51:03 user nova-compute[73450]:       <entry name="serial">a36f0a56-ed4a-4593-8c78-f71a53938fec</entry>
Aug 16 16:51:03 user nova-compute[73450]:       <entry name="uuid">a36f0a56-ed4a-4593-8c78-f71a53938fec</entry>
Aug 16 16:51:03 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:51:03 user nova-compute[73450]:     </system>
Aug 16 16:51:03 user nova-compute[73450]:   </sysinfo>
Aug 16 16:51:03 user nova-compute[73450]:   <os>
Aug 16 16:51:03 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:51:03 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:51:03 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:51:03 user nova-compute[73450]:   </os>
Aug 16 16:51:03 user nova-compute[73450]:   <features>
Aug 16 16:51:03 user nova-compute[73450]:     <acpi/>
Aug 16 16:51:03 user nova-compute[73450]:     <apic/>
Aug 16 16:51:03 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:51:03 user nova-compute[73450]:   </features>
Aug 16 16:51:03 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:51:03 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:51:03 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:51:03 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:51:03 user nova-compute[73450]:   </clock>
Aug 16 16:51:03 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:51:03 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:51:03 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:51:03 user nova-compute[73450]:   </cpu>
Aug 16 16:51:03 user nova-compute[73450]:   <devices>
Aug 16 16:51:03 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:51:03 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:51:03 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk"/>
Aug 16 16:51:03 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:51:03 user nova-compute[73450]:     </disk>
Aug 16 16:51:03 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:51:03 user nova-compute[73450]:       <mac address="fa:16:3e:05:57:b1"/>
Aug 16 16:51:03 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:03 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:51:03 user nova-compute[73450]:       <target dev="tapceda7838-27"/>
Aug 16 16:51:03 user nova-compute[73450]:     </interface>
Aug 16 16:51:03 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:51:03 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/console.log" append="off"/>
Aug 16 16:51:03 user nova-compute[73450]:     </serial>
Aug 16 16:51:03 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:51:03 user nova-compute[73450]:     <video>
Aug 16 16:51:03 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:03 user nova-compute[73450]:     </video>
Aug 16 16:51:03 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:51:03 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:51:03 user nova-compute[73450]:     </rng>
Aug 16 16:51:03 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:51:03 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:51:03 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:51:03 user nova-compute[73450]:     </memballoon>
Aug 16 16:51:03 user nova-compute[73450]:   </devices>
Aug 16 16:51:03 user nova-compute[73450]: </domain>
Aug 16 16:51:03 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-647448038',display_name='tempest-ServerRescueNegativeTestJSON-server-647448038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-647448038',id=28,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2lPh+HhM95TmGjXtvq4sutCHienP7AN5IgBpAy70Fwg/Whw0zVT1E7Tvo4JJvJKWkP5YREamZypxNg6rziWDDI5tJYQsQ75h3ZvKL2TXkkkA7726wwup2qEHkGy+SAYQ==',key_name='tempest-keypair-1753196274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-bx0iht3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d604d793314808984e92afdc5f5da0',uuid=a36f0a56-ed4a-4593-8c78-f71a53938fec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG os_vif [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceda7838-27, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapceda7838-27, col_values=(('external_ids', {'iface-id': 'ceda7838-2709-4eec-be04-e29e1127982b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:57:b1', 'vm-uuid': 'a36f0a56-ed4a-4593-8c78-f71a53938fec'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:03 user nova-compute[73450]: INFO os_vif [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27')
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:51:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:05:57:b1, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:51:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updated VIF entry in instance network info cache for port ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:51:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-23faef73-c034-4194-af2d-34763c1043d7 req-3b493e2f-2935-4f48-8c69-980138504cc9 service nova] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-167bc448-85a1-47c8-8b7c-29ed789db47d req-3fef16a0-b04c-4875-af8e-f2ddb0a2e54b service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-167bc448-85a1-47c8-8b7c-29ed789db47d req-3fef16a0-b04c-4875-af8e-f2ddb0a2e54b service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-167bc448-85a1-47c8-8b7c-29ed789db47d req-3fef16a0-b04c-4875-af8e-f2ddb0a2e54b service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-167bc448-85a1-47c8-8b7c-29ed789db47d req-3fef16a0-b04c-4875-af8e-f2ddb0a2e54b service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-167bc448-85a1-47c8-8b7c-29ed789db47d req-3fef16a0-b04c-4875-af8e-f2ddb0a2e54b service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:05 user nova-compute[73450]: WARNING nova.compute.manager [req-167bc448-85a1-47c8-8b7c-29ed789db47d req-3fef16a0-b04c-4875-af8e-f2ddb0a2e54b service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state building and task_state spawning.
Aug 16 16:51:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204667.4585464, a36f0a56-ed4a-4593-8c78-f71a53938fec => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Resumed (Lifecycle Event)
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance spawned successfully.
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204667.4621375, a36f0a56-ed4a-4593-8c78-f71a53938fec => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Started (Lifecycle Event)
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:07 user nova-compute[73450]: INFO nova.compute.manager [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Took 7.01 seconds to build instance.
Aug 16 16:51:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b1824e05-48a8-467e-91ea-0e504a6c8edb tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.156s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-e8a3c5f3-e525-4b35-a60a-4d900b6813dc req-3ca0326d-9abb-4fca-b786-233a260f0371 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e8a3c5f3-e525-4b35-a60a-4d900b6813dc req-3ca0326d-9abb-4fca-b786-233a260f0371 service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e8a3c5f3-e525-4b35-a60a-4d900b6813dc req-3ca0326d-9abb-4fca-b786-233a260f0371 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e8a3c5f3-e525-4b35-a60a-4d900b6813dc req-3ca0326d-9abb-4fca-b786-233a260f0371 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-e8a3c5f3-e525-4b35-a60a-4d900b6813dc req-3ca0326d-9abb-4fca-b786-233a260f0371 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:07 user nova-compute[73450]: WARNING nova.compute.manager [req-e8a3c5f3-e525-4b35-a60a-4d900b6813dc req-3ca0326d-9abb-4fca-b786-233a260f0371 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state active and task_state None.
Aug 16 16:51:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaLSMitE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:09 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:09 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:09 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d810c028-5b79-4765-8bd1-917ddf66c063]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:51:09 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe4f12-ad7e-4d6b-9fda-e889861db1a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0] added
Aug 16 16:51:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[508373b6-0f8e-4746-a53f-9a2569a3d333]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6553136-12eb-4032-81ce-7405cba20f06]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaLSMitE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaLSMitE" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e51d9-3010-4322-bb43-3c66b2eac1b9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaLSMitE'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[14078629-8bb7-4d64-ada4-f438095b74f1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a2516e-925a-42d4-82e7-7422e413ab47]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:09 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:09 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:09 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:09 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:09 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:09 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db35d86-3888-41c5-8836-c8581b616388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260]
Aug 16 16:51:09 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260] successful.
Aug 16 16:51:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc75b6-1d5f-498f-8bf0-1f2cb3d9898b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066a2fe-e46a-4e2a-b718-40bab6d2f233]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 (non-flash)
Aug 16 16:51:10 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:10 user nova-compute[73450]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 (non-flash)
Aug 16 16:51:10 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839065b-6cc7-4d5c-8692-d34dd4f7f556]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:51:10 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaLSMitE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23235663232383264', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235663232383264', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lazy-loading 'flavor' on Instance uuid 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:51:11 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:11 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:51:11 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:51:11 user nova-compute[73450]:   <serial>bb37af09-5f21-45c1-a36d-b8fedba87bb0</serial>
Aug 16 16:51:11 user nova-compute[73450]: </disk>
Aug 16 16:51:11 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] No VIF found with MAC fa:16:3e:49:bb:7a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:51:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5430f6f8-f564-4bad-8e80-05fbcc0de191 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.666s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:14 user nova-compute[73450]: INFO nova.compute.manager [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Detaching volume bb37af09-5f21-45c1-a36d-b8fedba87bb0
Aug 16 16:51:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:15 user nova-compute[73450]: INFO nova.virt.block_device [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Attempting to driver detach volume bb37af09-5f21-45c1-a36d-b8fedba87bb0 from mountpoint /dev/vdb
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Attempting to detach device vdb from instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:51:15 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:15 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:51:15 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:51:15 user nova-compute[73450]:   <serial>bb37af09-5f21-45c1-a36d-b8fedba87bb0</serial>
Aug 16 16:51:15 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:51:15 user nova-compute[73450]: </disk>
Aug 16 16:51:15 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:51:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Successfully detached device vdb from instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 from the persistent domain config.
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:51:15 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:15 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 16:51:15 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:51:15 user nova-compute[73450]:   <serial>bb37af09-5f21-45c1-a36d-b8fedba87bb0</serial>
Aug 16 16:51:15 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:51:15 user nova-compute[73450]: </disk>
Aug 16 16:51:15 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204675.4877036, 2a3845e6-2b7f-4305-be33-9d483da2adc9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:51:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Successfully detached device vdb from instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 from the live domain config.
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaLSMitE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:15 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537f685-d6b5-49d7-9eed-fe8c74737f97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc50bc-b0e4-4099-998a-a3c290e25064]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 (non-flash)
Aug 16 16:51:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:15 user nova-compute[73450]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 (non-flash)
Aug 16 16:51:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28015e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[36336fa9-916d-4605-9e1d-6a499985abc2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790bc52-6c82-4c3e-a230-1729c0fb5c67]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2f1472-2382-4feb-8ebd-735f79a3a168]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1793871a-75c9-4643-8211-b545aaf17c82]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[731108f9-74df-4727-bfff-712dcb3932d1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7b655-4d1c-4297-993a-f90b1fc6611c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260]
Aug 16 16:51:15 user nova-compute[73450]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0, portal: 172.16.0.220,3260] successful.
Aug 16 16:51:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb37af09-5f21-45c1-a36d-b8fedba87bb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e900b-16b2-4c01-813a-7d01b4efe294]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] <== disconnect_volume: return (359ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:51:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lazy-loading 'flavor' on Instance uuid 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d2031397-31be-427f-813c-1676b37ed6a0 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.475s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:51:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:51:18 user nova-compute[73450]: INFO nova.compute.claims [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Claim successful on node user
Aug 16 16:51:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:51:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:51:19 user nova-compute[73450]: INFO nova.virt.block_device [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Booting with volume-backed-image f5d06caa-7cbd-45eb-944b-5dc2a22ca419 at /dev/vda
Aug 16 16:51:19 user nova-compute[73450]: DEBUG nova.policy [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3275ae2aaad34aa8adb49e5de0dbe238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f813e9d59945b58a7f0141fb29ca46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:51:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Successfully created port: ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Successfully updated port: ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-changed-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Refreshing instance network info cache due to event network-changed-ca02a931-7ab6-4e5f-8345-670aea6eedab. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] Acquiring lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updating instance_info_cache with network_info: [{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance network_info: |[{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] Acquired lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.network.neutron [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Refreshing network info cache for port ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:51:21 user nova-compute[73450]: INFO nova.compute.claims [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Claim successful on node user
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updated VIF entry in instance network info cache for port ca02a931-7ab6-4e5f-8345-670aea6eedab. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updating instance_info_cache with network_info: [{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7e892186-cfda-4af4-88d5-72880e90da34 req-90aefc45-2ae8-4b8a-b789-5141d549aab0 service nova] Releasing lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:51:22 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.policy [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5076f53f390e4fc4b69fe0aa206a916c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee3a81531b34430b14fad85fe6c400c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:51:22 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Creating image(s)
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "dbb6306e843fce651c8aed3361799c67e33a5a91" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "dbb6306e843fce651c8aed3361799c67e33a5a91" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.part --force-share --output=json" returned: 0 in 0.218s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG nova.virt.images [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] 68a957b4-d282-4a04-bbe6-aeef51b5d19a was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.part /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Successfully created port: ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.part /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.converted" returned: 0 in 0.274s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "dbb6306e843fce651c8aed3361799c67e33a5a91" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.228s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:23 user nova-compute[73450]: INFO nova.compute.manager [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Unrescuing
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "dbb6306e843fce651c8aed3361799c67e33a5a91" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "dbb6306e843fce651c8aed3361799c67e33a5a91" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91,backing_fmt=raw /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Successfully updated port: ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91,backing_fmt=raw /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk 1073741824" returned: 0 in 0.070s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing instance network info cache due to event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "dbb6306e843fce651c8aed3361799c67e33a5a91" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'flavor' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dfd43129-528c-4785-93c6-27dff9e78b90 req-90c10a5f-1eba-446d-8ad1-d81dc220dd1a service nova] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Cannot resize image /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'migration_context' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Ensure instance console log exists: /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:24 user nova-compute[73450]: INFO nova.compute.manager [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Terminating instance
Aug 16 16:51:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing instance network info cache due to event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.network.neutron [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f6c8d3e-6c92-4d42-8f82-dad8847d1e04 req-d1d1e117-1db2-4afe-b932-cb968d6fc21c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-unplugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f6c8d3e-6c92-4d42-8f82-dad8847d1e04 req-d1d1e117-1db2-4afe-b932-cb968d6fc21c service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f6c8d3e-6c92-4d42-8f82-dad8847d1e04 req-d1d1e117-1db2-4afe-b932-cb968d6fc21c service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f6c8d3e-6c92-4d42-8f82-dad8847d1e04 req-d1d1e117-1db2-4afe-b932-cb968d6fc21c service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f6c8d3e-6c92-4d42-8f82-dad8847d1e04 req-d1d1e117-1db2-4afe-b932-cb968d6fc21c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-unplugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f6c8d3e-6c92-4d42-8f82-dad8847d1e04 req-d1d1e117-1db2-4afe-b932-cb968d6fc21c service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-unplugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance network_info: |[{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Start _get_guest_xml network_info=[{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:51:18Z,direct_url=<?>,disk_format='qcow2',id=68a957b4-d282-4a04-bbe6-aeef51b5d19a,min_disk=0,min_ram=0,name='tempest-scenario-img--507670599',owner='4ee3a81531b34430b14fad85fe6c400c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:51:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': '68a957b4-d282-4a04-bbe6-aeef51b5d19a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance destroyed successfully.
Aug 16 16:51:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Instance destroyed successfully.
Aug 16 16:51:25 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:25 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'resources' on Instance uuid 93e6b212-411d-408e-94a2-37a64232f8e5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018494408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018494408',id=19,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi0AjEzjAp0y9wC6wtaJb6A8GOtK4WEmiGjVIByW/okJacDOnQ3MnbPq65C/qNlF+LYqmS/3wwM7Uix6eMtBwtBkeuHUCNQ9gnSimuX4aG+LYX5HeONxRsFiKnu2L6aZw==',key_name='tempest-keypair-1720053238',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:49:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-5dj8p0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:49:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=93e6b212-411d-408e-94a2-37a64232f8e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "c1b77572-0f96-4d2f-958d-238e07b02809", "address": "fa:16:3e:68:62:ee", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1b77572-0f", "ovs_interfaceid": "c1b77572-0f96-4d2f-958d-238e07b02809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG os_vif [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1b77572-0f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:51:18Z,direct_url=<?>,disk_format='qcow2',id=68a957b4-d282-4a04-bbe6-aeef51b5d19a,min_disk=0,min_ram=0,name='tempest-scenario-img--507670599',owner='4ee3a81531b34430b14fad85fe6c400c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:51:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:51:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167881879',display_name='tempest-TestMinimumBasicScenario-server-1167881879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167881879',id=30,image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvpuiF/GcK+jBYxfRiaZkIdPRIBolZ2O5+5duCiC4VDIg25CdFE52GrAtZgEdNyH9sNHH9uY4Lr0Pt3q/cMXVrSYvduWJYWl2r4RGsnGkMi+BprC8rFWeVSXAHrxuvnFw==',key_name='tempest-TestMinimumBasicScenario-20692004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-1vfwhcwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:22Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=cfe56b3e-2553-4a80-990b-974d4a8d84a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'pci_devices' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:51:26 user nova-compute[73450]:   <uuid>cfe56b3e-2553-4a80-990b-974d4a8d84a1</uuid>
Aug 16 16:51:26 user nova-compute[73450]:   <name>instance-0000001e</name>
Aug 16 16:51:26 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:51:26 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:51:26 user nova-compute[73450]:   <metadata>
Aug 16 16:51:26 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:51:26 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:51:26 user nova-compute[73450]:       <nova:name>tempest-TestMinimumBasicScenario-server-1167881879</nova:name>
Aug 16 16:51:26 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:51:25</nova:creationTime>
Aug 16 16:51:26 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:51:26 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:51:26 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:51:26 user nova-compute[73450]:       <nova:owner>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:user uuid="5076f53f390e4fc4b69fe0aa206a916c">tempest-TestMinimumBasicScenario-1533627500-project-member</nova:user>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:project uuid="4ee3a81531b34430b14fad85fe6c400c">tempest-TestMinimumBasicScenario-1533627500</nova:project>
Aug 16 16:51:26 user nova-compute[73450]:       </nova:owner>
Aug 16 16:51:26 user nova-compute[73450]:       <nova:root type="image" uuid="68a957b4-d282-4a04-bbe6-aeef51b5d19a"/>
Aug 16 16:51:26 user nova-compute[73450]:       <nova:ports>
Aug 16 16:51:26 user nova-compute[73450]:         <nova:port uuid="ad991858-4f5a-4176-99b9-fcc0c75c91b4">
Aug 16 16:51:26 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:51:26 user nova-compute[73450]:         </nova:port>
Aug 16 16:51:26 user nova-compute[73450]:       </nova:ports>
Aug 16 16:51:26 user nova-compute[73450]:     </nova:instance>
Aug 16 16:51:26 user nova-compute[73450]:   </metadata>
Aug 16 16:51:26 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:51:26 user nova-compute[73450]:     <system>
Aug 16 16:51:26 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:51:26 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:51:26 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:51:26 user nova-compute[73450]:       <entry name="serial">cfe56b3e-2553-4a80-990b-974d4a8d84a1</entry>
Aug 16 16:51:26 user nova-compute[73450]:       <entry name="uuid">cfe56b3e-2553-4a80-990b-974d4a8d84a1</entry>
Aug 16 16:51:26 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:51:26 user nova-compute[73450]:     </system>
Aug 16 16:51:26 user nova-compute[73450]:   </sysinfo>
Aug 16 16:51:26 user nova-compute[73450]:   <os>
Aug 16 16:51:26 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:51:26 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:51:26 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:51:26 user nova-compute[73450]:   </os>
Aug 16 16:51:26 user nova-compute[73450]:   <features>
Aug 16 16:51:26 user nova-compute[73450]:     <acpi/>
Aug 16 16:51:26 user nova-compute[73450]:     <apic/>
Aug 16 16:51:26 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:51:26 user nova-compute[73450]:   </features>
Aug 16 16:51:26 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:51:26 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:51:26 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:51:26 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:51:26 user nova-compute[73450]:   </clock>
Aug 16 16:51:26 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:51:26 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:51:26 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:51:26 user nova-compute[73450]:   </cpu>
Aug 16 16:51:26 user nova-compute[73450]:   <devices>
Aug 16 16:51:26 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:51:26 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:51:26 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk"/>
Aug 16 16:51:26 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:51:26 user nova-compute[73450]:     </disk>
Aug 16 16:51:26 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:51:26 user nova-compute[73450]:       <mac address="fa:16:3e:c8:de:4f"/>
Aug 16 16:51:26 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:26 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:51:26 user nova-compute[73450]:       <target dev="tapad991858-4f"/>
Aug 16 16:51:26 user nova-compute[73450]:     </interface>
Aug 16 16:51:26 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:51:26 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/console.log" append="off"/>
Aug 16 16:51:26 user nova-compute[73450]:     </serial>
Aug 16 16:51:26 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:51:26 user nova-compute[73450]:     <video>
Aug 16 16:51:26 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:26 user nova-compute[73450]:     </video>
Aug 16 16:51:26 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:51:26 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:51:26 user nova-compute[73450]:     </rng>
Aug 16 16:51:26 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:51:26 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:51:26 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:51:26 user nova-compute[73450]:     </memballoon>
Aug 16 16:51:26 user nova-compute[73450]:   </devices>
Aug 16 16:51:26 user nova-compute[73450]: </domain>
Aug 16 16:51:26 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167881879',display_name='tempest-TestMinimumBasicScenario-server-1167881879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167881879',id=30,image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvpuiF/GcK+jBYxfRiaZkIdPRIBolZ2O5+5duCiC4VDIg25CdFE52GrAtZgEdNyH9sNHH9uY4Lr0Pt3q/cMXVrSYvduWJYWl2r4RGsnGkMi+BprC8rFWeVSXAHrxuvnFw==',key_name='tempest-TestMinimumBasicScenario-20692004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-1vfwhcwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:22Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=cfe56b3e-2553-4a80-990b-974d4a8d84a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG os_vif [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:51:26 user nova-compute[73450]: INFO os_vif [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:62:ee,bridge_name='br-int',has_traffic_filtering=True,id=c1b77572-0f96-4d2f-958d-238e07b02809,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1b77572-0f')
Aug 16 16:51:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Deleting instance files /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5_del
Aug 16 16:51:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Deletion of /opt/stack/data/nova/instances/93e6b212-411d-408e-94a2-37a64232f8e5_del complete
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad991858-4f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad991858-4f, col_values=(('external_ids', {'iface-id': 'ad991858-4f5a-4176-99b9-fcc0c75c91b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:de:4f', 'vm-uuid': 'cfe56b3e-2553-4a80-990b-974d4a8d84a1'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: INFO os_vif [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f')
Aug 16 16:51:26 user nova-compute[73450]: INFO nova.compute.manager [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No VIF found with MAC fa:16:3e:c8:de:4f, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:26 user nova-compute[73450]: WARNING nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:26 user nova-compute[73450]: WARNING nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:26 user nova-compute[73450]: WARNING nova.compute.manager [req-2bb59287-851f-4bcb-a8ea-b5e528cd5555 req-b279df3e-03dd-4869-9a8c-7a6f770d3854 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updated VIF entry in instance network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3a57134d-2ac0-4588-b436-c84b43bb166e req-4f6bf6d8-4e6f-428d-b300-4e84b1851756 service nova] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing instance network info cache due to event network-changed-7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Refreshing network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-f332a74a-51ed-456e-81c5-7d8e9b66c0c9 req-1ed0bbf2-4375-46a6-b688-0e3c13c9321f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f332a74a-51ed-456e-81c5-7d8e9b66c0c9 req-1ed0bbf2-4375-46a6-b688-0e3c13c9321f service nova] Acquiring lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f332a74a-51ed-456e-81c5-7d8e9b66c0c9 req-1ed0bbf2-4375-46a6-b688-0e3c13c9321f service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f332a74a-51ed-456e-81c5-7d8e9b66c0c9 req-1ed0bbf2-4375-46a6-b688-0e3c13c9321f service nova] Lock "93e6b212-411d-408e-94a2-37a64232f8e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-f332a74a-51ed-456e-81c5-7d8e9b66c0c9 req-1ed0bbf2-4375-46a6-b688-0e3c13c9321f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] No waiting events found dispatching network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:27 user nova-compute[73450]: WARNING nova.compute.manager [req-f332a74a-51ed-456e-81c5-7d8e9b66c0c9 req-1ed0bbf2-4375-46a6-b688-0e3c13c9321f service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received unexpected event network-vif-plugged-c1b77572-0f96-4d2f-958d-238e07b02809 for instance with vm_state active and task_state deleting.
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updated VIF entry in instance network info cache for port 7fbf4a53-062d-4fc5-990a-fcff33353b26. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6d292a66-bd03-464a-aafc-52667fef69d2 req-1bf73138-2b2d-41a1-a2d8-438ce3483033 service nova] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:27 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Took 1.75 seconds to deallocate network for instance.
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:28 user nova-compute[73450]: WARNING nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:28 user nova-compute[73450]: WARNING nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:28 user nova-compute[73450]: WARNING nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-3da06c32-6e95-4358-8734-870a6111f565 req-c0d64209-1d6d-485c-b487-4923bd9d5ba0 service nova] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Received event network-vif-deleted-c1b77572-0f96-4d2f-958d-238e07b02809 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:28 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Deleted allocations for instance 93e6b212-411d-408e-94a2-37a64232f8e5
Aug 16 16:51:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-57fd9cfc-ad14-4677-8758-3b039b80dfb1 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "93e6b212-411d-408e-94a2-37a64232f8e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.971s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-c83b3256-87e7-46f1-b535-f87852e805c4 req-3508c0a5-83ea-443a-aa95-ff74b9904c4c service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c83b3256-87e7-46f1-b535-f87852e805c4 req-3508c0a5-83ea-443a-aa95-ff74b9904c4c service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c83b3256-87e7-46f1-b535-f87852e805c4 req-3508c0a5-83ea-443a-aa95-ff74b9904c4c service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c83b3256-87e7-46f1-b535-f87852e805c4 req-3508c0a5-83ea-443a-aa95-ff74b9904c4c service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-c83b3256-87e7-46f1-b535-f87852e805c4 req-3508c0a5-83ea-443a-aa95-ff74b9904c4c service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:29 user nova-compute[73450]: WARNING nova.compute.manager [req-c83b3256-87e7-46f1-b535-f87852e805c4 req-3508c0a5-83ea-443a-aa95-ff74b9904c4c service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state building and task_state spawning.
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG os_brick.utils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa846d-d76d-4a07-b191-923616989eed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f2f858-3a65-4b9a-a44b-ae3de317c9ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9791e-cc96-42e8-b3fc-48c253dcf873]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86162c2b-3230-4bcf-9cf6-b0e1c0429996]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:51:30 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b242d8f-42bf-4151-893b-72aa96879cec]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG os_brick.utils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updating existing volume attachment record: d7980512-44ae-4dc2-9ed4-d80fef88e47d {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:30 user nova-compute[73450]: WARNING nova.compute.manager [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:30 user nova-compute[73450]: WARNING nova.compute.manager [req-d2603581-50fc-4134-a5ee-073e10c358e3 req-d25152eb-d760-4fb0-8620-5021a509fa66 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:30 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:51:30 user nova-compute[73450]: INFO nova.compute.claims [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Claim successful on node user
Aug 16 16:51:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204691.2115088, cfe56b3e-2553-4a80-990b-974d4a8d84a1 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] VM Resumed (Lifecycle Event)
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d170fe63-5add-4800-bf93-2c1a5aedc0d4 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance spawned successfully.
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204691.2130053, cfe56b3e-2553-4a80-990b-974d4a8d84a1 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] VM Started (Lifecycle Event)
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for c605c1c9-7033-48a9-8ef8-c1815683bd16 due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204691.2173302, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Resumed (Lifecycle Event)
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Took 8.93 seconds to spawn the instance on the hypervisor.
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-1e072bee-7434-40ba-961c-54f69ed3ac50 req-6a739d29-6e5e-4927-9ba3-43eb9825baa5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1e072bee-7434-40ba-961c-54f69ed3ac50 req-6a739d29-6e5e-4927-9ba3-43eb9825baa5 service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1e072bee-7434-40ba-961c-54f69ed3ac50 req-6a739d29-6e5e-4927-9ba3-43eb9825baa5 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1e072bee-7434-40ba-961c-54f69ed3ac50 req-6a739d29-6e5e-4927-9ba3-43eb9825baa5 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-1e072bee-7434-40ba-961c-54f69ed3ac50 req-6a739d29-6e5e-4927-9ba3-43eb9825baa5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:31 user nova-compute[73450]: WARNING nova.compute.manager [req-1e072bee-7434-40ba-961c-54f69ed3ac50 req-6a739d29-6e5e-4927-9ba3-43eb9825baa5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state building and task_state spawning.
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204691.2193623, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Started (Lifecycle Event)
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.policy [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c95d246b43b45b4963f9d750ae89fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b953d82d634106aa0fb9574fafdc0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.compute.manager [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Took 9.92 seconds to build instance.
Aug 16 16:51:31 user nova-compute[73450]: INFO nova.virt.block_device [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Booting with volume 6e49dfcc-137c-4c22-a3c6-96dc5fb6163e at /dev/vda
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-0a47d18d-9b3b-4ae8-900b-ceef21d9b2a8 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.046s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG os_brick.utils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6346d689-2732-4552-8372-2ede87080cef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf3c37-54e8-4068-b4db-91bbac9a2887]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa945da-3328-4df0-8aea-f77f51d07d99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c630b31f-6639-4beb-96aa-04770c333242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:51:31 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:51:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[903daa10-4df4-4b56-9716-f631629b5eaf]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG os_brick.utils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:31 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updating existing volume attachment record: f61de78a-9c41-4594-9ed2-6743ed3a7396 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:51:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Successfully created port: bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Successfully updated port: bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquired lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-changed-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Refreshing instance network info cache due to event network-changed-bd4045fc-71f0-402d-bc5c-cd447d7731a6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] Acquiring lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updating instance_info_cache with network_info: [{"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Releasing lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Instance network_info: |[{"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] Acquired lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Refreshing network info cache for port bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:51:34 user nova-compute[73450]: DEBUG nova.network.neutron [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updated VIF entry in instance network info cache for port bd4045fc-71f0-402d-bc5c-cd447d7731a6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:51:34 user nova-compute[73450]: DEBUG nova.network.neutron [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updating instance_info_cache with network_info: [{"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7c614609-8570-4142-87e5-b5a15a84aed6 req-b5d5db4c-ed84-457d-bfff-3ad34d5bea5a service nova] Releasing lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:40 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204685.9227953, 93e6b212-411d-408e-94a2-37a64232f8e5 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:40 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] VM Stopped (Lifecycle Event)
Aug 16 16:51:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-585f3edc-e940-42c4-a1cd-476a04d25603 None None] [instance: 93e6b212-411d-408e-94a2-37a64232f8e5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:51:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Creating image(s)
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Ensure instance console log exists: /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Start _get_guest_xml network_info=[{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'd7980512-44ae-4dc2-9ed4-d80fef88e47d', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5104e1fc-bcbb-4643-9d66-6f0db4339428', 'attached_at': '', 'detached_at': '', 'volume_id': '382bea4f-adac-453a-9c86-539b1d170d4d', 'serial': '382bea4f-adac-453a-9c86-539b1d170d4d'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:51:42 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:42 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:42 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:42 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:42 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c976a5c-b8d1-432d-b239-7422a2a2d33f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:51:42 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0860d5ff-bd2d-425e-8814-a4ef3b9b69d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d] added
Aug 16 16:51:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38520528-d657-4bea-8e44-e0f1c18d9a90]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d799e09c-4694-45ab-acfc-51754f043f97]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kREIuKXs {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kREIuKXs" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21f45d-067b-4ac6-8e5b-130fa999a046]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kREIuKXs'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53edb6c-378a-427b-b6c9-0e619dc2bdf7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[00748c78-d0c6-4892-b9ee-a12b6d42aa10]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae6e49-cbe6-4203-808a-be332b7af2d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260]
Aug 16 16:51:42 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260] successful.
Aug 16 16:51:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5373a9-d6c5-484c-a96b-ddf15e65832f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[63189fb9-d3c6-4fa7-a3f1-614d7ba4f606]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:42 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:42 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf47580-be65-4db5-9466-679a6b039df1]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:51:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:51:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Creating image(s)
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Ensure instance console log exists: /opt/stack/data/nova/instances/9a63d50d-5b5b-401e-b6fc-960008baca37/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Start _get_guest_xml network_info=[{"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f61de78a-9c41-4594-9ed2-6743ed3a7396', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUAQXGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a63d50d-5b5b-401e-b6fc-960008baca37', 'attached_at': '', 'detached_at': '', 'volume_id': '6e49dfcc-137c-4c22-a3c6-96dc5fb6163e', 'serial': '6e49dfcc-137c-4c22-a3c6-96dc5fb6163e'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:51:43 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:43 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUAQXGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:43 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26161633565366531', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633565366531', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.079s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:43 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:43 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f50161f-89c0-4666-a9e6-318577da5f52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:51:43 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2097810802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2097810802',id=29,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-ujbswy8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:19Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=5104e1fc-bcbb-4643-9d66-6f0db4339428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'pci_devices' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:51:43 user nova-compute[73450]:   <uuid>5104e1fc-bcbb-4643-9d66-6f0db4339428</uuid>
Aug 16 16:51:43 user nova-compute[73450]:   <name>instance-0000001d</name>
Aug 16 16:51:43 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:51:43 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:51:43 user nova-compute[73450]:   <metadata>
Aug 16 16:51:43 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:51:43 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:51:43 user nova-compute[73450]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2097810802</nova:name>
Aug 16 16:51:43 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:51:42</nova:creationTime>
Aug 16 16:51:43 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:51:43 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:51:43 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:51:43 user nova-compute[73450]:       <nova:owner>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:user uuid="3275ae2aaad34aa8adb49e5de0dbe238">tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member</nova:user>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:project uuid="88f813e9d59945b58a7f0141fb29ca46">tempest-ServerBootFromVolumeStableRescueTest-311543227</nova:project>
Aug 16 16:51:43 user nova-compute[73450]:       </nova:owner>
Aug 16 16:51:43 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:51:43 user nova-compute[73450]:       <nova:ports>
Aug 16 16:51:43 user nova-compute[73450]:         <nova:port uuid="ca02a931-7ab6-4e5f-8345-670aea6eedab">
Aug 16 16:51:43 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 16:51:43 user nova-compute[73450]:         </nova:port>
Aug 16 16:51:43 user nova-compute[73450]:       </nova:ports>
Aug 16 16:51:43 user nova-compute[73450]:     </nova:instance>
Aug 16 16:51:43 user nova-compute[73450]:   </metadata>
Aug 16 16:51:43 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:51:43 user nova-compute[73450]:     <system>
Aug 16 16:51:43 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:51:43 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:51:43 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:51:43 user nova-compute[73450]:       <entry name="serial">5104e1fc-bcbb-4643-9d66-6f0db4339428</entry>
Aug 16 16:51:43 user nova-compute[73450]:       <entry name="uuid">5104e1fc-bcbb-4643-9d66-6f0db4339428</entry>
Aug 16 16:51:43 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:51:43 user nova-compute[73450]:     </system>
Aug 16 16:51:43 user nova-compute[73450]:   </sysinfo>
Aug 16 16:51:43 user nova-compute[73450]:   <os>
Aug 16 16:51:43 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:51:43 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:51:43 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:51:43 user nova-compute[73450]:   </os>
Aug 16 16:51:43 user nova-compute[73450]:   <features>
Aug 16 16:51:43 user nova-compute[73450]:     <acpi/>
Aug 16 16:51:43 user nova-compute[73450]:     <apic/>
Aug 16 16:51:43 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:51:43 user nova-compute[73450]:   </features>
Aug 16 16:51:43 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:51:43 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:51:43 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:51:43 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:51:43 user nova-compute[73450]:   </clock>
Aug 16 16:51:43 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:51:43 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:51:43 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:51:43 user nova-compute[73450]:   </cpu>
Aug 16 16:51:43 user nova-compute[73450]:   <devices>
Aug 16 16:51:43 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:51:43 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:43 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 16:51:43 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:51:43 user nova-compute[73450]:       <serial>382bea4f-adac-453a-9c86-539b1d170d4d</serial>
Aug 16 16:51:43 user nova-compute[73450]:     </disk>
Aug 16 16:51:43 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:51:43 user nova-compute[73450]:       <mac address="fa:16:3e:07:fa:9c"/>
Aug 16 16:51:43 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:43 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:51:43 user nova-compute[73450]:       <target dev="tapca02a931-7a"/>
Aug 16 16:51:43 user nova-compute[73450]:     </interface>
Aug 16 16:51:43 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:51:43 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/console.log" append="off"/>
Aug 16 16:51:43 user nova-compute[73450]:     </serial>
Aug 16 16:51:43 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:51:43 user nova-compute[73450]:     <video>
Aug 16 16:51:43 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:43 user nova-compute[73450]:     </video>
Aug 16 16:51:43 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:51:43 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:51:43 user nova-compute[73450]:     </rng>
Aug 16 16:51:43 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:51:43 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:51:43 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:51:43 user nova-compute[73450]:     </memballoon>
Aug 16 16:51:43 user nova-compute[73450]:   </devices>
Aug 16 16:51:43 user nova-compute[73450]: </domain>
Aug 16 16:51:43 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2097810802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2097810802',id=29,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-ujbswy8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:19Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=5104e1fc-bcbb-4643-9d66-6f0db4339428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_vif [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ca2b4-c6c4-4007-9a22-a4f6674cd50d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e] added
Aug 16 16:51:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca02a931-7a, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca02a931-7a, col_values=(('external_ids', {'iface-id': 'ca02a931-7ab6-4e5f-8345-670aea6eedab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:fa:9c', 'vm-uuid': '5104e1fc-bcbb-4643-9d66-6f0db4339428'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:43 user nova-compute[73450]: INFO os_vif [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a')
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1d0361-93bc-4073-8ee8-e99970723384]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0413bd-1ee6-470d-b177-2c84c695e9fb]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUAQXGMK {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUAQXGMK" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3867988-955b-435c-ab47-ac23c809bea5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tUAQXGMK'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No VIF found with MAC fa:16:3e:07:fa:9c, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b00c54-91d3-4d22-a92a-c2122a8caec7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[770d10dc-3bf5-46e7-9dd7-f0f3a8585d9e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:43 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b2c008-5f08-4e99-b9fe-addfb4074740]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260]
Aug 16 16:51:44 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260] successful.
Aug 16 16:51:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e585dd-07e4-4da4-ac9c-3deadf04aa1b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af88571-ad9e-499e-8c5f-efeb1a24705b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:51:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:44 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:51:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c168f-a697-4b53-a1e8-6d666ba7824e]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUAQXGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:51:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '26465313362396437', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465313362396437', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-695182127',display_name='tempest-TestVolumeBootPattern-volume-backed-server-695182127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-695182127',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGGq5nJSF3Kc3FFDpfeDSFav4Ck9R9/RI6KY4FHLqpORzDT5oYPJ7cWHV/30yPzOcK+k6sr4yb5NEMan1X6O5MZANW9+PqzlHszQo68dSgAhaQnTlc5H4nybcJJYqYXVA==',key_name='tempest-keypair-1585604788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-3umzyb0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=9a63d50d-5b5b-401e-b6fc-960008baca37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a63d50d-5b5b-401e-b6fc-960008baca37 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:51:45 user nova-compute[73450]:   <uuid>9a63d50d-5b5b-401e-b6fc-960008baca37</uuid>
Aug 16 16:51:45 user nova-compute[73450]:   <name>instance-0000001f</name>
Aug 16 16:51:45 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:51:45 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:51:45 user nova-compute[73450]:   <metadata>
Aug 16 16:51:45 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:51:45 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:51:45 user nova-compute[73450]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-695182127</nova:name>
Aug 16 16:51:45 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:51:43</nova:creationTime>
Aug 16 16:51:45 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:51:45 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:51:45 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:51:45 user nova-compute[73450]:       <nova:owner>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:user uuid="8c95d246b43b45b4963f9d750ae89fbd">tempest-TestVolumeBootPattern-717711848-project-member</nova:user>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:project uuid="a3b953d82d634106aa0fb9574fafdc0d">tempest-TestVolumeBootPattern-717711848</nova:project>
Aug 16 16:51:45 user nova-compute[73450]:       </nova:owner>
Aug 16 16:51:45 user nova-compute[73450]:       <nova:ports>
Aug 16 16:51:45 user nova-compute[73450]:         <nova:port uuid="bd4045fc-71f0-402d-bc5c-cd447d7731a6">
Aug 16 16:51:45 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 16:51:45 user nova-compute[73450]:         </nova:port>
Aug 16 16:51:45 user nova-compute[73450]:       </nova:ports>
Aug 16 16:51:45 user nova-compute[73450]:     </nova:instance>
Aug 16 16:51:45 user nova-compute[73450]:   </metadata>
Aug 16 16:51:45 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:51:45 user nova-compute[73450]:     <system>
Aug 16 16:51:45 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:51:45 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:51:45 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:51:45 user nova-compute[73450]:       <entry name="serial">9a63d50d-5b5b-401e-b6fc-960008baca37</entry>
Aug 16 16:51:45 user nova-compute[73450]:       <entry name="uuid">9a63d50d-5b5b-401e-b6fc-960008baca37</entry>
Aug 16 16:51:45 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:51:45 user nova-compute[73450]:     </system>
Aug 16 16:51:45 user nova-compute[73450]:   </sysinfo>
Aug 16 16:51:45 user nova-compute[73450]:   <os>
Aug 16 16:51:45 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:51:45 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:51:45 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:51:45 user nova-compute[73450]:   </os>
Aug 16 16:51:45 user nova-compute[73450]:   <features>
Aug 16 16:51:45 user nova-compute[73450]:     <acpi/>
Aug 16 16:51:45 user nova-compute[73450]:     <apic/>
Aug 16 16:51:45 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:51:45 user nova-compute[73450]:   </features>
Aug 16 16:51:45 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:51:45 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:51:45 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:51:45 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:51:45 user nova-compute[73450]:   </clock>
Aug 16 16:51:45 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:51:45 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:51:45 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:51:45 user nova-compute[73450]:   </cpu>
Aug 16 16:51:45 user nova-compute[73450]:   <devices>
Aug 16 16:51:45 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:51:45 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:45 user nova-compute[73450]:       <source dev="/dev/sdd"/>
Aug 16 16:51:45 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:51:45 user nova-compute[73450]:       <serial>6e49dfcc-137c-4c22-a3c6-96dc5fb6163e</serial>
Aug 16 16:51:45 user nova-compute[73450]:     </disk>
Aug 16 16:51:45 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:51:45 user nova-compute[73450]:       <mac address="fa:16:3e:2c:6b:7b"/>
Aug 16 16:51:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:45 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:51:45 user nova-compute[73450]:       <target dev="tapbd4045fc-71"/>
Aug 16 16:51:45 user nova-compute[73450]:     </interface>
Aug 16 16:51:45 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:51:45 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/9a63d50d-5b5b-401e-b6fc-960008baca37/console.log" append="off"/>
Aug 16 16:51:45 user nova-compute[73450]:     </serial>
Aug 16 16:51:45 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:51:45 user nova-compute[73450]:     <video>
Aug 16 16:51:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:51:45 user nova-compute[73450]:     </video>
Aug 16 16:51:45 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:51:45 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:51:45 user nova-compute[73450]:     </rng>
Aug 16 16:51:45 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:51:45 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:51:45 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:51:45 user nova-compute[73450]:     </memballoon>
Aug 16 16:51:45 user nova-compute[73450]:   </devices>
Aug 16 16:51:45 user nova-compute[73450]: </domain>
Aug 16 16:51:45 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-695182127',display_name='tempest-TestVolumeBootPattern-volume-backed-server-695182127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-695182127',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGGq5nJSF3Kc3FFDpfeDSFav4Ck9R9/RI6KY4FHLqpORzDT5oYPJ7cWHV/30yPzOcK+k6sr4yb5NEMan1X6O5MZANW9+PqzlHszQo68dSgAhaQnTlc5H4nybcJJYqYXVA==',key_name='tempest-keypair-1585604788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-3umzyb0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=9a63d50d-5b5b-401e-b6fc-960008baca37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG os_vif [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd4045fc-71, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd4045fc-71, col_values=(('external_ids', {'iface-id': 'bd4045fc-71f0-402d-bc5c-cd447d7731a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:6b:7b', 'vm-uuid': '9a63d50d-5b5b-401e-b6fc-960008baca37'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: INFO os_vif [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71')
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No VIF found with MAC fa:16:3e:2c:6b:7b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-5091c659-67ae-472f-bab1-eb05310bb3db req-dbec3a28-2ef8-4b53-9a24-8df26fa19ea4 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5091c659-67ae-472f-bab1-eb05310bb3db req-dbec3a28-2ef8-4b53-9a24-8df26fa19ea4 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5091c659-67ae-472f-bab1-eb05310bb3db req-dbec3a28-2ef8-4b53-9a24-8df26fa19ea4 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5091c659-67ae-472f-bab1-eb05310bb3db req-dbec3a28-2ef8-4b53-9a24-8df26fa19ea4 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-5091c659-67ae-472f-bab1-eb05310bb3db req-dbec3a28-2ef8-4b53-9a24-8df26fa19ea4 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:45 user nova-compute[73450]: WARNING nova.compute.manager [req-5091c659-67ae-472f-bab1-eb05310bb3db req-dbec3a28-2ef8-4b53-9a24-8df26fa19ea4 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state building and task_state spawning.
Aug 16 16:51:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5d5058bd-b27e-4fcb-b460-984b2b06615b req-1388fa4b-c8a2-4c87-8fa1-44cb75d3477b service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d5058bd-b27e-4fcb-b460-984b2b06615b req-1388fa4b-c8a2-4c87-8fa1-44cb75d3477b service nova] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d5058bd-b27e-4fcb-b460-984b2b06615b req-1388fa4b-c8a2-4c87-8fa1-44cb75d3477b service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5d5058bd-b27e-4fcb-b460-984b2b06615b req-1388fa4b-c8a2-4c87-8fa1-44cb75d3477b service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5d5058bd-b27e-4fcb-b460-984b2b06615b req-1388fa4b-c8a2-4c87-8fa1-44cb75d3477b service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] No waiting events found dispatching network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:47 user nova-compute[73450]: WARNING nova.compute.manager [req-5d5058bd-b27e-4fcb-b460-984b2b06615b req-1388fa4b-c8a2-4c87-8fa1-44cb75d3477b service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received unexpected event network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 for instance with vm_state building and task_state spawning.
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-a7f99534-0f91-4cbb-8896-ad79eb8be331 req-3c0039fb-1475-40e3-840f-0a474a0c44a8 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a7f99534-0f91-4cbb-8896-ad79eb8be331 req-3c0039fb-1475-40e3-840f-0a474a0c44a8 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a7f99534-0f91-4cbb-8896-ad79eb8be331 req-3c0039fb-1475-40e3-840f-0a474a0c44a8 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a7f99534-0f91-4cbb-8896-ad79eb8be331 req-3c0039fb-1475-40e3-840f-0a474a0c44a8 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-a7f99534-0f91-4cbb-8896-ad79eb8be331 req-3c0039fb-1475-40e3-840f-0a474a0c44a8 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:47 user nova-compute[73450]: WARNING nova.compute.manager [req-a7f99534-0f91-4cbb-8896-ad79eb8be331 req-3c0039fb-1475-40e3-840f-0a474a0c44a8 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state building and task_state spawning.
Aug 16 16:51:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [{"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-c605c1c9-7033-48a9-8ef8-c1815683bd16" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:51:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.objects.instance [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attaching volume 14fcee51-e00e-4c78-b6f4-1a0aa787c035 to /dev/vdb
Aug 16 16:51:48 user nova-compute[73450]: DEBUG os_brick.utils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c463c62b-ff6a-4227-8331-ae5d4b2833d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e33774-9030-4f2e-9e3a-545042da143d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdab01b8-5084-42bc-8292-7cb4a05610ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0ea467-5e3d-4428-a7bd-b73d5e371abe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:51:48 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd8fd53-5c21-456e-9392-d27f1827602a]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG os_brick.utils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating existing volume attachment record: 8b7ffdd7-3630-4709-bfc0-f4935825d39b {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204708.6338253, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Resumed (Lifecycle Event)
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance spawned successfully.
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204708.6343095, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Started (Lifecycle Event)
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 16 16:51:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:48 user nova-compute[73450]: INFO nova.compute.manager [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Took 30.27 seconds to build instance.
Aug 16 16:51:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bcd2261a-10f4-41f1-b81f-3e97f3a99171 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.409s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204709.1347888, 9a63d50d-5b5b-401e-b6fc-960008baca37 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] VM Resumed (Lifecycle Event)
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Instance spawned successfully.
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204709.1370225, 9a63d50d-5b5b-401e-b6fc-960008baca37 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] VM Started (Lifecycle Event)
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-a9bba9a5-638a-4142-b211-44248aba4e85 req-8eee5a55-a101-48d3-9d66-8f3080ac5ccb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a9bba9a5-638a-4142-b211-44248aba4e85 req-8eee5a55-a101-48d3-9d66-8f3080ac5ccb service nova] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a9bba9a5-638a-4142-b211-44248aba4e85 req-8eee5a55-a101-48d3-9d66-8f3080ac5ccb service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a9bba9a5-638a-4142-b211-44248aba4e85 req-8eee5a55-a101-48d3-9d66-8f3080ac5ccb service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-a9bba9a5-638a-4142-b211-44248aba4e85 req-8eee5a55-a101-48d3-9d66-8f3080ac5ccb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] No waiting events found dispatching network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:51:49 user nova-compute[73450]: WARNING nova.compute.manager [req-a9bba9a5-638a-4142-b211-44248aba4e85 req-8eee5a55-a101-48d3-9d66-8f3080ac5ccb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received unexpected event network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 for instance with vm_state building and task_state spawning.
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 16 16:51:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:51:49 user nova-compute[73450]: INFO nova.compute.manager [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Took 18.74 seconds to build instance.
Aug 16 16:51:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5b071a28-6a21-4f69-9c5f-2abe9263020e tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.840s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:51:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=6881MB free_disk=23.688045501708984GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c605c1c9-7033-48a9-8ef8-c1815683bd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2a3845e6-2b7f-4305-be33-9d483da2adc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a36f0a56-ed4a-4593-8c78-f71a53938fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5104e1fc-bcbb-4643-9d66-6f0db4339428 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9a63d50d-5b5b-401e-b6fc-960008baca37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:51:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:51:57 user nova-compute[73450]: INFO nova.compute.manager [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Detaching volume 3b8e335d-3f46-45c0-b9f9-805287ca26a1
Aug 16 16:51:57 user nova-compute[73450]: INFO nova.virt.block_device [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Attempting to driver detach volume 3b8e335d-3f46-45c0-b9f9-805287ca26a1 from mountpoint /dev/vdb
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Attempting to detach device vdb from instance c605c1c9-7033-48a9-8ef8-c1815683bd16 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:51:57 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:57 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:51:57 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:51:57 user nova-compute[73450]:   <serial>3b8e335d-3f46-45c0-b9f9-805287ca26a1</serial>
Aug 16 16:51:57 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:51:57 user nova-compute[73450]: </disk>
Aug 16 16:51:57 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:51:57 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Successfully detached device vdb from instance c605c1c9-7033-48a9-8ef8-c1815683bd16 from the persistent domain config.
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c605c1c9-7033-48a9-8ef8-c1815683bd16 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:51:57 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:51:57 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:51:57 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:51:57 user nova-compute[73450]:   <serial>3b8e335d-3f46-45c0-b9f9-805287ca26a1</serial>
Aug 16 16:51:57 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:51:57 user nova-compute[73450]: </disk>
Aug 16 16:51:57 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204717.6942239, c605c1c9-7033-48a9-8ef8-c1815683bd16 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:51:57 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Successfully detached device vdb from instance c605c1c9-7033-48a9-8ef8-c1815683bd16 from the live domain config.
Aug 16 16:51:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'citXAFJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:51:57 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd926e5-927b-440d-a0c1-5958f8c7651c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e62af-0355-47c8-8071-31ed2e73529f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:51:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:51:57 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:51:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2707f6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9e6e3d-5b43-4658-81ee-a30e25cef2d9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d67c8-d43d-4b78-8152-8efa7e77e50b]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ba4aef-190c-4609-a2a9-8825e5b2492b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0529147-be79-4ffd-a4bb-8234c0997b95]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1a2bd2-4839-479b-bb06-1336f244dc35]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d223d3-8952-430e-b622-ec21a0b0447d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260]
Aug 16 16:51:57 user nova-compute[73450]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1, portal: 172.16.0.220,3260] successful.
Aug 16 16:51:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8e335d-3f46-45c0-b9f9-805287ca26a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db0be96-f327-4af7-8415-6f0343ac2bf8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] <== disconnect_volume: return (299ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'flavor' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:51:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a81d5358-db23-4177-a5cf-62893b995086 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:51:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgJAKlod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:52:00 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:52:00 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:52:00 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc543916-6a45-4207-a656-f02eb60af9a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:52:00 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c9db7-be53-4fb1-99f2-da3d992f6ff0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035] added
Aug 16 16:52:00 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ebc0b-910b-45ec-8a7a-fa399b6f06b0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1741e18-108e-49a6-a484-17aeedba87d9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgJAKlod {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgJAKlod" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a941fd-a5f7-4a5a-9272-d50ef42bc608]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgJAKlod'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e758b9-58c3-4468-bbaa-ea362a1f31c5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f059f099-1681-429d-9586-9920c5ab4104]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:00 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:00 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:00 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402ec14-5a4e-45fe-940a-d7b08e0366a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260]
Aug 16 16:52:00 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260] successful.
Aug 16 16:52:00 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb39c41-647a-4f56-9024-3048e3593ba5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[82198d2f-739d-45ef-9c63-9394a6131079]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 (non-flash)
Aug 16 16:52:01 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:01 user nova-compute[73450]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 (non-flash)
Aug 16 16:52:01 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c5482f-3956-474d-ae91-f21c502bad6b]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:52:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgJAKlod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23939373531623837', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939373531623837', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG nova.objects.instance [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:52:02 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:02 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:52:02 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:02 user nova-compute[73450]:   <serial>14fcee51-e00e-4c78-b6f4-1a0aa787c035</serial>
Aug 16 16:52:02 user nova-compute[73450]: </disk>
Aug 16 16:52:02 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No VIF found with MAC fa:16:3e:60:ff:4b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:52:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-95bcad0e-9713-40d9-afc4-188af1105762 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.301s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:06 user nova-compute[73450]: INFO nova.compute.manager [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Detaching volume 14fcee51-e00e-4c78-b6f4-1a0aa787c035
Aug 16 16:52:07 user nova-compute[73450]: INFO nova.virt.block_device [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attempting to driver detach volume 14fcee51-e00e-4c78-b6f4-1a0aa787c035 from mountpoint /dev/vdb
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Attempting to detach device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:52:07 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:07 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:52:07 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:07 user nova-compute[73450]:   <serial>14fcee51-e00e-4c78-b6f4-1a0aa787c035</serial>
Aug 16 16:52:07 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:52:07 user nova-compute[73450]: </disk>
Aug 16 16:52:07 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:52:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config.
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:52:07 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:07 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:52:07 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:07 user nova-compute[73450]:   <serial>14fcee51-e00e-4c78-b6f4-1a0aa787c035</serial>
Aug 16 16:52:07 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:52:07 user nova-compute[73450]: </disk>
Aug 16 16:52:07 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204727.5169497, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:52:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config.
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgJAKlod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:52:07 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e299337b-01f3-4102-b1b5-8ffd9b81936f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d574b166-99cc-467e-9195-00ae41a50b57]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 (non-flash)
Aug 16 16:52:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:07 user nova-compute[73450]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 (non-flash)
Aug 16 16:52:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28016fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcefbfe1-7813-49c2-9089-84cbc9b6ec65]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1a79f3-60cc-43ec-ac7d-f43aeb5d5f4d]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ea3b8-189b-499d-b8cc-e71b6bb42efb]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c515d90a-adcb-4ba9-b31f-d8b336d34929]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c2a92-407f-4cac-92c1-75e6848c9234]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceb88c7-5c1b-43e5-9100-28c2ae325a38]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260]
Aug 16 16:52:07 user nova-compute[73450]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035, portal: 172.16.0.220,3260] successful.
Aug 16 16:52:07 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14fcee51-e00e-4c78-b6f4-1a0aa787c035 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a5c48e-4f38-4a80-812c-459cf21f15a4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== disconnect_volume: return (297ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:52:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:52:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:08 user nova-compute[73450]: INFO nova.compute.manager [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Detaching volume 0542ef85-817d-48b8-849c-3ec07c3394af
Aug 16 16:52:08 user nova-compute[73450]: INFO nova.virt.block_device [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Attempting to driver detach volume 0542ef85-817d-48b8-849c-3ec07c3394af from mountpoint /dev/vdb
Aug 16 16:52:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Attempting to detach device vdb from instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:52:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:52:08 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:08 user nova-compute[73450]:   <source dev="/dev/sdf"/>
Aug 16 16:52:08 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:08 user nova-compute[73450]:   <serial>0542ef85-817d-48b8-849c-3ec07c3394af</serial>
Aug 16 16:52:08 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:52:08 user nova-compute[73450]: </disk>
Aug 16 16:52:08 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:52:08 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully detached device vdb from instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d from the persistent domain config.
Aug 16 16:52:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:52:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:52:08 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:08 user nova-compute[73450]:   <source dev="/dev/sdf"/>
Aug 16 16:52:08 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:08 user nova-compute[73450]:   <serial>0542ef85-817d-48b8-849c-3ec07c3394af</serial>
Aug 16 16:52:08 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:52:08 user nova-compute[73450]: </disk>
Aug 16 16:52:08 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204729.3262353, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:52:09 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully detached device vdb from instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d from the live domain config.
Aug 16 16:52:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUBZfxEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:52:09 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e09e452-7b36-452e-90ec-1c5d5e6f8464]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c35f002-63c2-48eb-ac3a-1001ed3deb4a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:09 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28d64ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af'): ({'sdf'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Removing single pathed devices sdf {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5a20d-2ef0-490f-9c5f-8f7b38de3dda]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a36273-8089-4cc4-b185-a433ed51fbbf]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flushing IO for device /dev/sdf {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2c58d-5507-4934-9eeb-58210cedc4f3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8da43-84a1-4a3f-8561-4fe753774ae7]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[04577232-a873-4561-9ef5-5eeeff6fe48d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10929a88-96bf-4593-bea1-5d93680ae682]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260]
Aug 16 16:52:09 user nova-compute[73450]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af, portal: 172.16.0.220,3260] successful.
Aug 16 16:52:09 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0542ef85-817d-48b8-849c-3ec07c3394af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab58ee4-feb9-4519-826e-947288e1729a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== disconnect_volume: return (276ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:52:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:52:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:10 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'flavor' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6511f46e-d9ae-427f-b70b-a6c770819cb7 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2281584e-a12c-43e4-ba2e-cd8c9cb3df66 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.108s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:12 user nova-compute[73450]: INFO nova.compute.manager [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Terminating instance
Aug 16 16:52:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f400d51-58c0-48b5-83c6-d47ade0a243a req-b734fc81-db94-4bf1-9b6a-75a0b6f63d04 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-vif-unplugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f400d51-58c0-48b5-83c6-d47ade0a243a req-b734fc81-db94-4bf1-9b6a-75a0b6f63d04 service nova] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f400d51-58c0-48b5-83c6-d47ade0a243a req-b734fc81-db94-4bf1-9b6a-75a0b6f63d04 service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f400d51-58c0-48b5-83c6-d47ade0a243a req-b734fc81-db94-4bf1-9b6a-75a0b6f63d04 service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f400d51-58c0-48b5-83c6-d47ade0a243a req-b734fc81-db94-4bf1-9b6a-75a0b6f63d04 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] No waiting events found dispatching network-vif-unplugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f400d51-58c0-48b5-83c6-d47ade0a243a req-b734fc81-db94-4bf1-9b6a-75a0b6f63d04 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-vif-unplugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:52:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:13 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Instance destroyed successfully.
Aug 16 16:52:13 user nova-compute[73450]: DEBUG nova.objects.instance [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lazy-loading 'resources' on Instance uuid 2a3845e6-2b7f-4305-be33-9d483da2adc9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-766446585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7664465',id=27,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7ptsuNRzAOO65/e0A4/fM4s3RwvtGPFJQSTTlSqKHc14yO8ANVo3GBcS8dFz5x522Ig18UOQhA+Cfz8cSnQW5li3ZIBPkrEQANbuvilVGTOn4vXTtMqcQ2kEHFP5uRHw==',key_name='tempest-keypair-1745175962',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a47137556b71441ab661873ba6b0d920',ramdisk_id='',reservation_id='r-4hldtfbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-852876150',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4efd4d0b693f4473b589a3a7d9459c37',uuid=2a3845e6-2b7f-4305-be33-9d483da2adc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Converting VIF {"id": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "address": "fa:16:3e:49:bb:7a", "network": {"id": "37f0b332-1a92-4884-b3ee-56329b6558a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-650240902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47137556b71441ab661873ba6b0d920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa4a57f-3a", "ovs_interfaceid": "6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG os_vif [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aa4a57f-3a, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:13 user nova-compute[73450]: INFO os_vif [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:bb:7a,bridge_name='br-int',has_traffic_filtering=True,id=6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1,network=Network(37f0b332-1a92-4884-b3ee-56329b6558a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa4a57f-3a')
Aug 16 16:52:13 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Deleting instance files /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9_del
Aug 16 16:52:13 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Deletion of /opt/stack/data/nova/instances/2a3845e6-2b7f-4305-be33-9d483da2adc9_del complete
Aug 16 16:52:13 user nova-compute[73450]: INFO nova.compute.manager [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 16:52:13 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:52:13 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:52:14 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Took 1.19 seconds to deallocate network for instance.
Aug 16 16:52:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-4bba0f4f-134d-4696-b02d-d610ff25bafa req-b9a37138-9b38-4c04-8584-509752449c8c service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-vif-deleted-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-d4632cba-e4d1-4297-b205-13a64053c0cf req-cded3efb-09e1-41ec-b8aa-cac9e88f6b23 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received event network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d4632cba-e4d1-4297-b205-13a64053c0cf req-cded3efb-09e1-41ec-b8aa-cac9e88f6b23 service nova] Acquiring lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d4632cba-e4d1-4297-b205-13a64053c0cf req-cded3efb-09e1-41ec-b8aa-cac9e88f6b23 service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d4632cba-e4d1-4297-b205-13a64053c0cf req-cded3efb-09e1-41ec-b8aa-cac9e88f6b23 service nova] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-d4632cba-e4d1-4297-b205-13a64053c0cf req-cded3efb-09e1-41ec-b8aa-cac9e88f6b23 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] No waiting events found dispatching network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:14 user nova-compute[73450]: WARNING nova.compute.manager [req-d4632cba-e4d1-4297-b205-13a64053c0cf req-cded3efb-09e1-41ec-b8aa-cac9e88f6b23 service nova] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Received unexpected event network-vif-plugged-6aa4a57f-3ad7-43f4-9d1f-6a4ea14cb3b1 for instance with vm_state deleted and task_state None.
Aug 16 16:52:15 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:52:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:52:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:15 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Deleted allocations for instance 2a3845e6-2b7f-4305-be33-9d483da2adc9
Aug 16 16:52:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-897191c0-c795-4dd5-8845-87174ef3df76 tempest-TestServerVolumeAttachScenarioOldVersion-852876150 tempest-TestServerVolumeAttachScenarioOldVersion-852876150-project-member] Lock "2a3845e6-2b7f-4305-be33-9d483da2adc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:52:18 user nova-compute[73450]: INFO nova.compute.claims [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Claim successful on node user
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:52:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:52:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.policy [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ed98f68e9e04991817ddf00c2c3cb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6dfde9621b946408c11bcf2465a9a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:52:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Creating image(s)
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk 1073741824" returned: 0 in 0.051s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Successfully created port: 6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Cannot resize image /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'migration_context' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Ensure instance console log exists: /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Successfully updated port: 6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing instance network info cache due to event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance network_info: |[{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.neutron [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Start _get_guest_xml network_info=[{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:52:21 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:52:21 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-82395713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-82395713',id=32,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9wx1HqZBFRRzpOrl0b+KPMCa/xZA+meAVheL62++nu24P3x9fkJQdajlP29b1w+b+PSuHYCqa6QjCNhlam1eZXSMj8WjwnDJoCUDhdDPHO/+0ObZwZTrBhHjiiaxc75Q==',key_name='tempest-keypair-2132504027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-r4x0kwml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=032b05e3-0db8-4029-9764-9fcce2eb55a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'pci_devices' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:52:21 user nova-compute[73450]:   <uuid>032b05e3-0db8-4029-9764-9fcce2eb55a7</uuid>
Aug 16 16:52:21 user nova-compute[73450]:   <name>instance-00000020</name>
Aug 16 16:52:21 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:52:21 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:52:21 user nova-compute[73450]:   <metadata>
Aug 16 16:52:21 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:52:21 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:52:21 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-82395713</nova:name>
Aug 16 16:52:21 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:52:21</nova:creationTime>
Aug 16 16:52:21 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:52:21 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:52:21 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:52:21 user nova-compute[73450]:       <nova:owner>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:user uuid="2ed98f68e9e04991817ddf00c2c3cb0e">tempest-AttachVolumeShelveTestJSON-405972124-project-member</nova:user>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:project uuid="c6dfde9621b946408c11bcf2465a9a3d">tempest-AttachVolumeShelveTestJSON-405972124</nova:project>
Aug 16 16:52:21 user nova-compute[73450]:       </nova:owner>
Aug 16 16:52:21 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:52:21 user nova-compute[73450]:       <nova:ports>
Aug 16 16:52:21 user nova-compute[73450]:         <nova:port uuid="6619da50-8624-4c5b-a838-615e36ce5fc6">
Aug 16 16:52:21 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:52:21 user nova-compute[73450]:         </nova:port>
Aug 16 16:52:21 user nova-compute[73450]:       </nova:ports>
Aug 16 16:52:21 user nova-compute[73450]:     </nova:instance>
Aug 16 16:52:21 user nova-compute[73450]:   </metadata>
Aug 16 16:52:21 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:52:21 user nova-compute[73450]:     <system>
Aug 16 16:52:21 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:52:21 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:52:21 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:52:21 user nova-compute[73450]:       <entry name="serial">032b05e3-0db8-4029-9764-9fcce2eb55a7</entry>
Aug 16 16:52:21 user nova-compute[73450]:       <entry name="uuid">032b05e3-0db8-4029-9764-9fcce2eb55a7</entry>
Aug 16 16:52:21 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:52:21 user nova-compute[73450]:     </system>
Aug 16 16:52:21 user nova-compute[73450]:   </sysinfo>
Aug 16 16:52:21 user nova-compute[73450]:   <os>
Aug 16 16:52:21 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:52:21 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:52:21 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:52:21 user nova-compute[73450]:   </os>
Aug 16 16:52:21 user nova-compute[73450]:   <features>
Aug 16 16:52:21 user nova-compute[73450]:     <acpi/>
Aug 16 16:52:21 user nova-compute[73450]:     <apic/>
Aug 16 16:52:21 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:52:21 user nova-compute[73450]:   </features>
Aug 16 16:52:21 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:52:21 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:52:21 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:52:21 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:52:21 user nova-compute[73450]:   </clock>
Aug 16 16:52:21 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:52:21 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:52:21 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:52:21 user nova-compute[73450]:   </cpu>
Aug 16 16:52:21 user nova-compute[73450]:   <devices>
Aug 16 16:52:21 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:52:21 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:52:21 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk"/>
Aug 16 16:52:21 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:52:21 user nova-compute[73450]:     </disk>
Aug 16 16:52:21 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:52:21 user nova-compute[73450]:       <mac address="fa:16:3e:fd:2e:34"/>
Aug 16 16:52:21 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:52:21 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:52:21 user nova-compute[73450]:       <target dev="tap6619da50-86"/>
Aug 16 16:52:21 user nova-compute[73450]:     </interface>
Aug 16 16:52:21 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:52:21 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/console.log" append="off"/>
Aug 16 16:52:21 user nova-compute[73450]:     </serial>
Aug 16 16:52:21 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:52:21 user nova-compute[73450]:     <video>
Aug 16 16:52:21 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:52:21 user nova-compute[73450]:     </video>
Aug 16 16:52:21 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:52:21 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:52:21 user nova-compute[73450]:     </rng>
Aug 16 16:52:21 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:52:21 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:52:21 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:52:21 user nova-compute[73450]:     </memballoon>
Aug 16 16:52:21 user nova-compute[73450]:   </devices>
Aug 16 16:52:21 user nova-compute[73450]: </domain>
Aug 16 16:52:21 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-82395713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-82395713',id=32,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9wx1HqZBFRRzpOrl0b+KPMCa/xZA+meAVheL62++nu24P3x9fkJQdajlP29b1w+b+PSuHYCqa6QjCNhlam1eZXSMj8WjwnDJoCUDhdDPHO/+0ObZwZTrBhHjiiaxc75Q==',key_name='tempest-keypair-2132504027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-r4x0kwml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=032b05e3-0db8-4029-9764-9fcce2eb55a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG os_vif [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6619da50-86, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6619da50-86, col_values=(('external_ids', {'iface-id': '6619da50-8624-4c5b-a838-615e36ce5fc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:2e:34', 'vm-uuid': '032b05e3-0db8-4029-9764-9fcce2eb55a7'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:21 user nova-compute[73450]: INFO os_vif [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86')
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:52:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No VIF found with MAC fa:16:3e:fd:2e:34, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:52:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updated VIF entry in instance network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:52:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:52:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f9a6ff71-f206-4b19-9afe-b5cb97d6fc47 req-cac95380-b022-4e7e-b803-9d4e1c84852c service nova] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-59a31920-409e-485d-8cad-3518bb92b85b req-78f47bca-1f8e-4616-8d45-ee8f07b9ac27 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-59a31920-409e-485d-8cad-3518bb92b85b req-78f47bca-1f8e-4616-8d45-ee8f07b9ac27 service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-59a31920-409e-485d-8cad-3518bb92b85b req-78f47bca-1f8e-4616-8d45-ee8f07b9ac27 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-59a31920-409e-485d-8cad-3518bb92b85b req-78f47bca-1f8e-4616-8d45-ee8f07b9ac27 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-59a31920-409e-485d-8cad-3518bb92b85b req-78f47bca-1f8e-4616-8d45-ee8f07b9ac27 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:23 user nova-compute[73450]: WARNING nova.compute.manager [req-59a31920-409e-485d-8cad-3518bb92b85b req-78f47bca-1f8e-4616-8d45-ee8f07b9ac27 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state building and task_state spawning.
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204745.1570275, 032b05e3-0db8-4029-9764-9fcce2eb55a7 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] VM Resumed (Lifecycle Event)
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance spawned successfully.
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204745.3340292, 032b05e3-0db8-4029-9764-9fcce2eb55a7 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] VM Started (Lifecycle Event)
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-5e9259dc-af29-432c-a11f-663976bd9a31 req-96a9ca40-91a2-4c84-a890-32d9c4de3108 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5e9259dc-af29-432c-a11f-663976bd9a31 req-96a9ca40-91a2-4c84-a890-32d9c4de3108 service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5e9259dc-af29-432c-a11f-663976bd9a31 req-96a9ca40-91a2-4c84-a890-32d9c4de3108 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5e9259dc-af29-432c-a11f-663976bd9a31 req-96a9ca40-91a2-4c84-a890-32d9c4de3108 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-5e9259dc-af29-432c-a11f-663976bd9a31 req-96a9ca40-91a2-4c84-a890-32d9c4de3108 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:25 user nova-compute[73450]: WARNING nova.compute.manager [req-5e9259dc-af29-432c-a11f-663976bd9a31 req-96a9ca40-91a2-4c84-a890-32d9c4de3108 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state building and task_state spawning.
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 16 16:52:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:25 user nova-compute[73450]: INFO nova.compute.manager [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Took 6.81 seconds to build instance.
Aug 16 16:52:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f53dc2d-863a-4c43-acc7-13e03b92dc87 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.909s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:28 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204733.1525388, 2a3845e6-2b7f-4305-be33-9d483da2adc9 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:52:28 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] VM Stopped (Lifecycle Event)
Aug 16 16:52:28 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9b7c5941-bb4f-4bf1-aa3a-83324b3885d9 None None] [instance: 2a3845e6-2b7f-4305-be33-9d483da2adc9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:31 user nova-compute[73450]: INFO nova.compute.manager [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Detaching volume b31eddbc-5530-48a8-886b-3ae816f6d7f4
Aug 16 16:52:31 user nova-compute[73450]: INFO nova.virt.block_device [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Attempting to driver detach volume b31eddbc-5530-48a8-886b-3ae816f6d7f4 from mountpoint /dev/vdb
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Attempting to detach device vdb from instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:52:31 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:31 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:52:31 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:31 user nova-compute[73450]:   <serial>b31eddbc-5530-48a8-886b-3ae816f6d7f4</serial>
Aug 16 16:52:31 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:52:31 user nova-compute[73450]: </disk>
Aug 16 16:52:31 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:52:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully detached device vdb from instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 from the persistent domain config.
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:52:31 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:52:31 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:52:31 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:52:31 user nova-compute[73450]:   <serial>b31eddbc-5530-48a8-886b-3ae816f6d7f4</serial>
Aug 16 16:52:31 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:52:31 user nova-compute[73450]: </disk>
Aug 16 16:52:31 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204751.9820507, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:52:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully detached device vdb from instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 from the live domain config.
Aug 16 16:52:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdvMbeKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:52:31 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:52:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:52:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a7d80-3dab-4d2e-972b-aca4b9a31e46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2fa682-0863-411e-a23b-b4b33bac22c3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:32 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:32 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:32 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:52:32 user nova-compute[73450]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 (non-flash)
Aug 16 16:52:32 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:52:32 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:52:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28d4d43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a23cc16-65c1-4776-9cab-566ea25e15e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925544f-6566-4ff2-8e46-c4826a2edb08]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0f2c1-eabe-4e03-83f5-06d85b5188dd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be46a60-d868-4515-94ad-79711766550a]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820ed5a-f8ca-439a-ab03-d330eeef72da]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee844dc-ddb2-49c3-ac77-19f94b0c6198]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260]
Aug 16 16:52:32 user nova-compute[73450]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4, portal: 172.16.0.220,3260] successful.
Aug 16 16:52:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b31eddbc-5530-48a8-886b-3ae816f6d7f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eeabd7-cd6c-4aa0-bcf9-fda33c7b23de]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== disconnect_volume: return (275ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:52:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-39abba9f-bd0c-4300-b079-5881f352c73e tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73450) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d8d280e-3fbf-47ac-a948-578e67d59edc req-bcd88cbe-e6a5-4eac-9a68-80e675c222e9 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8d280e-3fbf-47ac-a948-578e67d59edc req-bcd88cbe-e6a5-4eac-9a68-80e675c222e9 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8d280e-3fbf-47ac-a948-578e67d59edc req-bcd88cbe-e6a5-4eac-9a68-80e675c222e9 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d8d280e-3fbf-47ac-a948-578e67d59edc req-bcd88cbe-e6a5-4eac-9a68-80e675c222e9 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d8d280e-3fbf-47ac-a948-578e67d59edc req-bcd88cbe-e6a5-4eac-9a68-80e675c222e9 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:34 user nova-compute[73450]: WARNING nova.compute.manager [req-9d8d280e-3fbf-47ac-a948-578e67d59edc req-bcd88cbe-e6a5-4eac-9a68-80e675c222e9 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state active and task_state powering-off.
Aug 16 16:52:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance destroyed successfully.
Aug 16 16:52:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-160718f2-71bc-4f9a-bfb7-52676b061283 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.917s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-0ab03571-92e0-4e3b-b994-079b83999452 req-134d1fc8-7698-481f-a526-f2cf21dd707b service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ab03571-92e0-4e3b-b994-079b83999452 req-134d1fc8-7698-481f-a526-f2cf21dd707b service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ab03571-92e0-4e3b-b994-079b83999452 req-134d1fc8-7698-481f-a526-f2cf21dd707b service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ab03571-92e0-4e3b-b994-079b83999452 req-134d1fc8-7698-481f-a526-f2cf21dd707b service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-0ab03571-92e0-4e3b-b994-079b83999452 req-134d1fc8-7698-481f-a526-f2cf21dd707b service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:36 user nova-compute[73450]: WARNING nova.compute.manager [req-0ab03571-92e0-4e3b-b994-079b83999452 req-134d1fc8-7698-481f-a526-f2cf21dd707b service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state None.
Aug 16 16:52:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid 679cc7af-3bba-44b0-9d76-3f053f87dd80 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:47 user nova-compute[73450]: INFO nova.compute.manager [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Terminating instance
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updating instance_info_cache with network_info: [{"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-679cc7af-3bba-44b0-9d76-3f053f87dd80" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-6aa2906e-3bb3-401e-96c5-2e5727f9bf74 req-fb23e33a-32bd-4c7c-a3a2-fb506e8af6ca service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6aa2906e-3bb3-401e-96c5-2e5727f9bf74 req-fb23e33a-32bd-4c7c-a3a2-fb506e8af6ca service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6aa2906e-3bb3-401e-96c5-2e5727f9bf74 req-fb23e33a-32bd-4c7c-a3a2-fb506e8af6ca service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6aa2906e-3bb3-401e-96c5-2e5727f9bf74 req-fb23e33a-32bd-4c7c-a3a2-fb506e8af6ca service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-6aa2906e-3bb3-401e-96c5-2e5727f9bf74 req-fb23e33a-32bd-4c7c-a3a2-fb506e8af6ca service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-6aa2906e-3bb3-401e-96c5-2e5727f9bf74 req-fb23e33a-32bd-4c7c-a3a2-fb506e8af6ca service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Instance destroyed successfully.
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lazy-loading 'resources' on Instance uuid c605c1c9-7033-48a9-8ef8-c1815683bd16 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1187841430',display_name='tempest-ServerStableDeviceRescueTest-server-1187841430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1187841430',id=20,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4/x++wUoGZmru0aCRIEaekAPJ113Jc9WnArIHvJc3ey5w45JjdPec+EH16OHSJYMH1xUS9xeg4BoWRh+aX+sQ48X4gH3th5D0mdpnzZhvyvXYFHyEF1VjknFO445wpOw==',key_name='tempest-keypair-96903892',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2304f2dbd95141d49fcca835b05f3829',ramdisk_id='',reservation_id='r-3ljt4t07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-365323873',owner_user_name='tempest-ServerStableDeviceRescueTest-365323873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:51:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6ccf870c7044548ffe09751440eff1',uuid=c605c1c9-7033-48a9-8ef8-c1815683bd16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converting VIF {"id": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "address": "fa:16:3e:57:6a:da", "network": {"id": "5c2e33d3-0574-41a0-a547-c947c30feb78", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-381166584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2304f2dbd95141d49fcca835b05f3829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbf4a53-06", "ovs_interfaceid": "7fbf4a53-062d-4fc5-990a-fcff33353b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG os_vif [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fbf4a53-06, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: INFO os_vif [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6a:da,bridge_name='br-int',has_traffic_filtering=True,id=7fbf4a53-062d-4fc5-990a-fcff33353b26,network=Network(5c2e33d3-0574-41a0-a547-c947c30feb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbf4a53-06')
Aug 16 16:52:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Deleting instance files /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16_del
Aug 16 16:52:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Deletion of /opt/stack/data/nova/instances/c605c1c9-7033-48a9-8ef8-c1815683bd16_del complete
Aug 16 16:52:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:48 user nova-compute[73450]: INFO nova.compute.manager [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 16:52:48 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:52:48 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204754.5249174, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:52:49 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Stopped (Lifecycle Event)
Aug 16 16:52:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-29987864-26fc-4355-add1-94d9ad50c80e None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-29987864-26fc-4355-add1-94d9ad50c80e None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:49 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:52:49 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Took 1.30 seconds to deallocate network for instance.
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:50 user nova-compute[73450]: WARNING nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state deleted and task_state None.
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:50 user nova-compute[73450]: WARNING nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state deleted and task_state None.
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:50 user nova-compute[73450]: WARNING nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state deleted and task_state None.
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:50 user nova-compute[73450]: WARNING nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-unplugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state deleted and task_state None.
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe525f6e-2319-42dd-8d4f-43355c2fb941 req-ceb58a71-e1ad-4041-bd64-b783f0062258 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-deleted-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:50 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Deleted allocations for instance c605c1c9-7033-48a9-8ef8-c1815683bd16
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d7ddf6fe-a70f-46f2-88bf-6bac47d9e3c0 tempest-ServerStableDeviceRescueTest-365323873 tempest-ServerStableDeviceRescueTest-365323873-project-member] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-changed-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing instance network info cache due to event network-changed-ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG nova.network.neutron [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing network info cache for port ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'flavor' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:51 user nova-compute[73450]: INFO nova.compute.manager [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Attaching volume 8a14db3e-01bf-4eed-9b14-e9f8124af96a to /dev/vdb
Aug 16 16:52:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.network.neutron [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updated VIF entry in instance network info cache for port ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.network.neutron [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2fbbe9-3271-43ff-94d7-cac2f7ad5cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d926ca88-c936-4009-882a-28813d48f2eb req-db0e1fcd-1dca-4e47-821b-452d9e482fa4 service nova] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3f2e20-c287-4bb1-9479-a25578aeb4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37ddae-e009-44d9-accd-21cbf2149fd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a622d-1342-40a2-9adb-3f2c0d63a00f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:52:52 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a5ec60-bc77-45bc-9fbf-3966b0efc59f]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG os_brick.utils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating existing volume attachment record: da3a4ce3-2f50-402a-ab93-48821122a8e4 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-33f450b6-56b4-4dd5-a96a-a2569237709a req-2ccd75f0-6878-4dc9-953e-0967c33278f7 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-33f450b6-56b4-4dd5-a96a-a2569237709a req-2ccd75f0-6878-4dc9-953e-0967c33278f7 service nova] Acquiring lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-33f450b6-56b4-4dd5-a96a-a2569237709a req-2ccd75f0-6878-4dc9-953e-0967c33278f7 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-33f450b6-56b4-4dd5-a96a-a2569237709a req-2ccd75f0-6878-4dc9-953e-0967c33278f7 service nova] Lock "c605c1c9-7033-48a9-8ef8-c1815683bd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-33f450b6-56b4-4dd5-a96a-a2569237709a req-2ccd75f0-6878-4dc9-953e-0967c33278f7 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] No waiting events found dispatching network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:52 user nova-compute[73450]: WARNING nova.compute.manager [req-33f450b6-56b4-4dd5-a96a-a2569237709a req-2ccd75f0-6878-4dc9-953e-0967c33278f7 service nova] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Received unexpected event network-vif-plugged-7fbf4a53-062d-4fc5-990a-fcff33353b26 for instance with vm_state deleted and task_state None.
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:52:57 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:52:57 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=6848MB free_disk=23.807987213134766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a36f0a56-ed4a-4593-8c78-f71a53938fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5104e1fc-bcbb-4643-9d66-6f0db4339428 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9a63d50d-5b5b-401e-b6fc-960008baca37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032b05e3-0db8-4029-9764-9fcce2eb55a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:52:57 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:52:58 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:52:58 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:52:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:52:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:59 user nova-compute[73450]: INFO nova.compute.manager [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Terminating instance
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-d006a744-a329-4620-a4af-0590143c2a02 req-ab80817a-805b-42e0-a1d3-3ae58e2f85ac service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d006a744-a329-4620-a4af-0590143c2a02 req-ab80817a-805b-42e0-a1d3-3ae58e2f85ac service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d006a744-a329-4620-a4af-0590143c2a02 req-ab80817a-805b-42e0-a1d3-3ae58e2f85ac service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d006a744-a329-4620-a4af-0590143c2a02 req-ab80817a-805b-42e0-a1d3-3ae58e2f85ac service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-d006a744-a329-4620-a4af-0590143c2a02 req-ab80817a-805b-42e0-a1d3-3ae58e2f85ac service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-d006a744-a329-4620-a4af-0590143c2a02 req-ab80817a-805b-42e0-a1d3-3ae58e2f85ac service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Instance destroyed successfully.
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.objects.instance [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'resources' on Instance uuid 2cc75551-2782-41ec-b5dc-07bbd62b2e7d {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2063771279',display_name='tempest-ServerActionsTestOtherA-server-777207070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2063771279',id=23,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQmCjEwBWBT/s+RkkCOjc/eGOP9z0w95KzLeTdPqlgCuTZqJVaN5DjiHNfWqPwKgKEuD9tdNOXK1xjbGitp8WqrUfrXMvUumz62835vCPBQJqnwiRELQisWoi404DiWjA==',key_name='tempest-keypair-1009333049',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-nhiu05y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:49:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=2cc75551-2782-41ec-b5dc-07bbd62b2e7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "584b7d85-9923-49f7-96df-27900e697677", "address": "fa:16:3e:5f:6d:f2", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap584b7d85-99", "ovs_interfaceid": "584b7d85-9923-49f7-96df-27900e697677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG os_vif [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap584b7d85-99, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: INFO os_vif [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=584b7d85-9923-49f7-96df-27900e697677,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap584b7d85-99')
Aug 16 16:52:59 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Deleting instance files /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d_del
Aug 16 16:52:59 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Deletion of /opt/stack/data/nova/instances/2cc75551-2782-41ec-b5dc-07bbd62b2e7d_del complete
Aug 16 16:52:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:52:59 user nova-compute[73450]: INFO nova.compute.manager [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 16:52:59 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:52:59 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:53:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:01 user nova-compute[73450]: INFO nova.compute.manager [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attaching volume d6186f29-4909-467c-be24-505bcc573c2c to /dev/vdb
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:01 user nova-compute[73450]: WARNING nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state deleting.
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:01 user nova-compute[73450]: WARNING nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state deleting.
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:01 user nova-compute[73450]: WARNING nova.compute.manager [req-6e9f9056-e089-4b1f-b33b-79ef8e154211 req-e913064a-5edf-4861-a60a-7cec290a4a87 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state active and task_state deleting.
Aug 16 16:53:01 user nova-compute[73450]: DEBUG os_brick.utils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943402c-9182-4ece-b636-74ed8b138e74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bdf548-f1dc-4da6-9d55-5e5de96029d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799a4de-8a9f-49fb-9f1d-a6d1d850ab79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c3eba-8c2e-4c3f-b554-cdce9e4ced51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:53:01 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:53:01 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0237595f-454f-4cd5-9080-212a21901bfb]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG os_brick.utils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:01 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating existing volume attachment record: b0be2aa0-b4df-4893-b362-884de74ac198 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:53:02 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:02 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Took 2.13 seconds to deallocate network for instance.
Aug 16 16:53:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:02 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:53:02 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:53:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:02 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Deleted allocations for instance 2cc75551-2782-41ec-b5dc-07bbd62b2e7d
Aug 16 16:53:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-703e86f9-a4e9-4285-bf37-a59c9dea55e5 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.659s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:03 user nova-compute[73450]: WARNING nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-unplugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state deleted and task_state None.
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] Acquiring lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] Lock "2cc75551-2782-41ec-b5dc-07bbd62b2e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] No waiting events found dispatching network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:03 user nova-compute[73450]: WARNING nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received unexpected event network-vif-plugged-584b7d85-9923-49f7-96df-27900e697677 for instance with vm_state deleted and task_state None.
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-490e2504-51ed-4be9-bf7e-e97a36f14655 req-64e173ed-fcbf-40ae-8ac9-f6b776cd5207 service nova] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Received event network-vif-deleted-584b7d85-9923-49f7-96df-27900e697677 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204768.518472, c605c1c9-7033-48a9-8ef8-c1815683bd16 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:03 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] VM Stopped (Lifecycle Event)
Aug 16 16:53:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PoLturYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:03 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:03 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:03 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:53:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ab166de9-abc4-4c78-b443-49b5916441e6 None None] [instance: c605c1c9-7033-48a9-8ef8-c1815683bd16] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e0c55d-0803-4d18-b5d7-2416df9a1edd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:53:03 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe1b1e-3794-4484-8fa2-fa345092b8b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a] added
Aug 16 16:53:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54280d7-98a8-418c-9e97-7a8c87e507da]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f9331-bbe6-4feb-8765-234f592e3b87]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PoLturYc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PoLturYc" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4c0f1-5f06-441f-a5b0-9e6618b7917f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PoLturYc'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8126f7-1fe6-4aa9-810b-8bafa0b102a8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9add1-1d7c-44b3-9d21-592cf4064cf3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[401509bb-e318-413d-91c4-65ac530050e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260]
Aug 16 16:53:03 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[98497561-aff1-40b2-9d6a-a65cf5c7ddb4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b74f23-6279-4380-ad8a-422ffb5bd930]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:03 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87857ad-b2f0-46ad-83b8-52845b29653d]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:53:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PoLturYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26264616130323030', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264616130323030', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'flavor' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:53:04 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:04 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:53:04 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:53:04 user nova-compute[73450]:   <serial>8a14db3e-01bf-4eed-9b14-e9f8124af96a</serial>
Aug 16 16:53:04 user nova-compute[73450]: </disk>
Aug 16 16:53:04 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:53:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:05:57:b1, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6fecfce6-9c30-4c89-aee7-dbdc7eb2ac65 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.563s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:06 user nova-compute[73450]: INFO nova.compute.manager [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Rescuing
Aug 16 16:53:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:53:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-1ea68f3a-e706-433e-8d9f-3deb192a2a2a req-9040449b-5c8c-456c-a89d-2efca8fab87e service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1ea68f3a-e706-433e-8d9f-3deb192a2a2a req-9040449b-5c8c-456c-a89d-2efca8fab87e service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1ea68f3a-e706-433e-8d9f-3deb192a2a2a req-9040449b-5c8c-456c-a89d-2efca8fab87e service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1ea68f3a-e706-433e-8d9f-3deb192a2a2a req-9040449b-5c8c-456c-a89d-2efca8fab87e service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-1ea68f3a-e706-433e-8d9f-3deb192a2a2a req-9040449b-5c8c-456c-a89d-2efca8fab87e service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:07 user nova-compute[73450]: WARNING nova.compute.manager [req-1ea68f3a-e706-433e-8d9f-3deb192a2a2a req-9040449b-5c8c-456c-a89d-2efca8fab87e service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state active and task_state rescuing.
Aug 16 16:53:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance destroyed successfully.
Aug 16 16:53:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Attempting rescue
Aug 16 16:53:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73450) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:53:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Creating image(s)
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG nova.objects.instance [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'trusted_certs' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue" returned: 0 in 0.065s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.objects.instance [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'migration_context' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Start _get_guest_xml network_info=[{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:05:57:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.objects.instance [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'resources' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.objects.instance [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'numa_topology' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:08 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:08 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.objects.instance [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'vcpu_model' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-647448038',display_name='tempest-ServerRescueNegativeTestJSON-server-647448038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-647448038',id=28,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2lPh+HhM95TmGjXtvq4sutCHienP7AN5IgBpAy70Fwg/Whw0zVT1E7Tvo4JJvJKWkP5YREamZypxNg6rziWDDI5tJYQsQ75h3ZvKL2TXkkkA7726wwup2qEHkGy+SAYQ==',key_name='tempest-keypair-1753196274',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-bx0iht3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d604d793314808984e92afdc5f5da0',uuid=a36f0a56-ed4a-4593-8c78-f71a53938fec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:05:57:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "vif_mac": "fa:16:3e:05:57:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.objects.instance [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'pci_devices' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:53:08 user nova-compute[73450]:   <uuid>a36f0a56-ed4a-4593-8c78-f71a53938fec</uuid>
Aug 16 16:53:08 user nova-compute[73450]:   <name>instance-0000001c</name>
Aug 16 16:53:08 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:53:08 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:53:08 user nova-compute[73450]:   <metadata>
Aug 16 16:53:08 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:53:08 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:53:08 user nova-compute[73450]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-647448038</nova:name>
Aug 16 16:53:08 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:53:08</nova:creationTime>
Aug 16 16:53:08 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:53:08 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:53:08 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:53:08 user nova-compute[73450]:       <nova:owner>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:user uuid="19d604d793314808984e92afdc5f5da0">tempest-ServerRescueNegativeTestJSON-976614040-project-member</nova:user>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:project uuid="ad178c8525774ad2a342015b9dc1fbf2">tempest-ServerRescueNegativeTestJSON-976614040</nova:project>
Aug 16 16:53:08 user nova-compute[73450]:       </nova:owner>
Aug 16 16:53:08 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:53:08 user nova-compute[73450]:       <nova:ports>
Aug 16 16:53:08 user nova-compute[73450]:         <nova:port uuid="ceda7838-2709-4eec-be04-e29e1127982b">
Aug 16 16:53:08 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 16:53:08 user nova-compute[73450]:         </nova:port>
Aug 16 16:53:08 user nova-compute[73450]:       </nova:ports>
Aug 16 16:53:08 user nova-compute[73450]:     </nova:instance>
Aug 16 16:53:08 user nova-compute[73450]:   </metadata>
Aug 16 16:53:08 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:53:08 user nova-compute[73450]:     <system>
Aug 16 16:53:08 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:53:08 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:53:08 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:53:08 user nova-compute[73450]:       <entry name="serial">a36f0a56-ed4a-4593-8c78-f71a53938fec</entry>
Aug 16 16:53:08 user nova-compute[73450]:       <entry name="uuid">a36f0a56-ed4a-4593-8c78-f71a53938fec</entry>
Aug 16 16:53:08 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:53:08 user nova-compute[73450]:     </system>
Aug 16 16:53:08 user nova-compute[73450]:   </sysinfo>
Aug 16 16:53:08 user nova-compute[73450]:   <os>
Aug 16 16:53:08 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:53:08 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:53:08 user nova-compute[73450]:   </os>
Aug 16 16:53:08 user nova-compute[73450]:   <features>
Aug 16 16:53:08 user nova-compute[73450]:     <acpi/>
Aug 16 16:53:08 user nova-compute[73450]:     <apic/>
Aug 16 16:53:08 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:53:08 user nova-compute[73450]:   </features>
Aug 16 16:53:08 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:53:08 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:53:08 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:53:08 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:53:08 user nova-compute[73450]:   </clock>
Aug 16 16:53:08 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:53:08 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:53:08 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:53:08 user nova-compute[73450]:   </cpu>
Aug 16 16:53:08 user nova-compute[73450]:   <devices>
Aug 16 16:53:08 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:53:08 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:53:08 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue"/>
Aug 16 16:53:08 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:53:08 user nova-compute[73450]:     </disk>
Aug 16 16:53:08 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:53:08 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:53:08 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk"/>
Aug 16 16:53:08 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:53:08 user nova-compute[73450]:     </disk>
Aug 16 16:53:08 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:53:08 user nova-compute[73450]:       <mac address="fa:16:3e:05:57:b1"/>
Aug 16 16:53:08 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:08 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:53:08 user nova-compute[73450]:       <target dev="tapceda7838-27"/>
Aug 16 16:53:08 user nova-compute[73450]:     </interface>
Aug 16 16:53:08 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:53:08 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/console.log" append="off"/>
Aug 16 16:53:08 user nova-compute[73450]:     </serial>
Aug 16 16:53:08 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:53:08 user nova-compute[73450]:     <video>
Aug 16 16:53:08 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:08 user nova-compute[73450]:     </video>
Aug 16 16:53:08 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:53:08 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:53:08 user nova-compute[73450]:     </rng>
Aug 16 16:53:08 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:53:08 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:53:08 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:53:08 user nova-compute[73450]:     </memballoon>
Aug 16 16:53:08 user nova-compute[73450]:   </devices>
Aug 16 16:53:08 user nova-compute[73450]: </domain>
Aug 16 16:53:08 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:53:08 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance destroyed successfully.
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] No VIF found with MAC fa:16:3e:05:57:b1, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:09 user nova-compute[73450]: INFO nova.compute.manager [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Rescuing
Aug 16 16:53:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG nova.network.neutron [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-895e83a7-4619-4989-b683-81571a2f205e req-5b38c631-3624-4394-8864-473709819890 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-895e83a7-4619-4989-b683-81571a2f205e req-5b38c631-3624-4394-8864-473709819890 service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-895e83a7-4619-4989-b683-81571a2f205e req-5b38c631-3624-4394-8864-473709819890 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-895e83a7-4619-4989-b683-81571a2f205e req-5b38c631-3624-4394-8864-473709819890 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG nova.compute.manager [req-895e83a7-4619-4989-b683-81571a2f205e req-5b38c631-3624-4394-8864-473709819890 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:09 user nova-compute[73450]: WARNING nova.compute.manager [req-895e83a7-4619-4989-b683-81571a2f205e req-5b38c631-3624-4394-8864-473709819890 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state active and task_state rescuing.
Aug 16 16:53:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG nova.network.neutron [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updating instance_info_cache with network_info: [{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-01989a01-4e86-42f2-b0fd-cf6f175100df req-7b6c2263-ba28-4f95-b06d-a0f4e81216cf service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-01989a01-4e86-42f2-b0fd-cf6f175100df req-7b6c2263-ba28-4f95-b06d-a0f4e81216cf service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-01989a01-4e86-42f2-b0fd-cf6f175100df req-7b6c2263-ba28-4f95-b06d-a0f4e81216cf service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-01989a01-4e86-42f2-b0fd-cf6f175100df req-7b6c2263-ba28-4f95-b06d-a0f4e81216cf service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-01989a01-4e86-42f2-b0fd-cf6f175100df req-7b6c2263-ba28-4f95-b06d-a0f4e81216cf service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:11 user nova-compute[73450]: WARNING nova.compute.manager [req-01989a01-4e86-42f2-b0fd-cf6f175100df req-7b6c2263-ba28-4f95-b06d-a0f4e81216cf service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state rescuing.
Aug 16 16:53:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance destroyed successfully.
Aug 16 16:53:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Attempting a stable device rescue
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73450) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:53:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Creating image(s)
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "/opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "/opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "bc23d070d13ac8dd570d31a40623001be032798d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "bc23d070d13ac8dd570d31a40623001be032798d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:11 user nova-compute[73450]: WARNING nova.compute.manager [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state active and task_state rescuing.
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:11 user nova-compute[73450]: WARNING nova.compute.manager [req-49415b98-0868-4b69-a4ac-3ccb5293648e req-a8caf04c-606f-4137-9560-0e8f6dab0872 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state active and task_state rescuing.
Aug 16 16:53:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for a36f0a56-ed4a-4593-8c78-f71a53938fec due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:53:12 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204792.0142343, a36f0a56-ed4a-4593-8c78-f71a53938fec => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:12 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Resumed (Lifecycle Event)
Aug 16 16:53:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-096c3741-abdb-4fb0-ba0b-edf1872e17fa tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:53:13 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204792.015354, a36f0a56-ed4a-4593-8c78-f71a53938fec => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:13 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Started (Lifecycle Event)
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.part --force-share --output=json" returned: 0 in 0.323s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.virt.images [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] a2150947-5e05-4085-a9e5-f1e8e110986f was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.part /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-823202e9-e610-43a2-9935-19b938c3430e req-d5a9e051-ecbd-4385-af46-565b92077e1d service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-823202e9-e610-43a2-9935-19b938c3430e req-d5a9e051-ecbd-4385-af46-565b92077e1d service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-823202e9-e610-43a2-9935-19b938c3430e req-d5a9e051-ecbd-4385-af46-565b92077e1d service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-823202e9-e610-43a2-9935-19b938c3430e req-d5a9e051-ecbd-4385-af46-565b92077e1d service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-823202e9-e610-43a2-9935-19b938c3430e req-d5a9e051-ecbd-4385-af46-565b92077e1d service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:13 user nova-compute[73450]: WARNING nova.compute.manager [req-823202e9-e610-43a2-9935-19b938c3430e req-d5a9e051-ecbd-4385-af46-565b92077e1d service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state rescuing.
Aug 16 16:53:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoyhVSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:13 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:13 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:13 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb66da-9509-4473-a2be-99f1f8645c46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:53:13 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.052s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3808dd-7757-4343-9966-c9071e540db8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c] added
Aug 16 16:53:13 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb50875-fe15-4f1f-a7ca-b9ce80154f2c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.121s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2035072f-44f1-4429-951d-c73ac72d6192]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoyhVSXc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoyhVSXc" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f68aee-d4df-4b5e-8c05-5990a86f5b3d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoyhVSXc'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705c490-7ccf-4864-ae8a-496295cb793e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.178s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f74dd6-e6a5-4e8c-834a-55eaf47a0fe9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f0ec54-adc1-4609-a414-f3842e4545af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260]
Aug 16 16:53:14 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce60b910-eb9b-44fa-a78e-c0af56c6ed35]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.part /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.converted" returned: 0 in 1.000s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[203819af-0e36-4919-87e2-1d9345591515]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)
Aug 16 16:53:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:14 user nova-compute[73450]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)
Aug 16 16:53:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.796s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77be6bab-beb9-47d2-813e-4df89c3db4e2]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoyhVSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d.converted --force-share --output=json" returned: 0 in 0.324s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "bc23d070d13ac8dd570d31a40623001be032798d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.145s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "bc23d070d13ac8dd570d31a40623001be032798d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "bc23d070d13ac8dd570d31a40623001be032798d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204779.8024547, 2cc75551-2782-41ec-b5dc-07bbd62b2e7d => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:14 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] VM Stopped (Lifecycle Event)
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d --force-share --output=json" returned: 0 in 0.217s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d,backing_fmt=raw /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-799b2b03-71fb-4d14-b5dd-06867fd525b9 None None] [instance: 2cc75551-2782-41ec-b5dc-07bbd62b2e7d] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d,backing_fmt=raw /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue" returned: 0 in 0.071s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "bc23d070d13ac8dd570d31a40623001be032798d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'migration_context' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Start _get_guest_xml network_info=[{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "vif_mac": "fa:16:3e:07:fa:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2150947-5e05-4085-a9e5-f1e8e110986f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'd7980512-44ae-4dc2-9ed4-d80fef88e47d', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5104e1fc-bcbb-4643-9d66-6f0db4339428', 'attached_at': '', 'detached_at': '', 'volume_id': '382bea4f-adac-453a-9c86-539b1d170d4d', 'serial': '382bea4f-adac-453a-9c86-539b1d170d4d'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'resources' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'numa_topology' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:14 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:14 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.objects.instance [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:15 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.864s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== connect_volume: return (1866ms) {'type': 'block', 'scsi_wwn': '26233643532626130', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233643532626130', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.329s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:15 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:15 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.objects.instance [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e08f4fc-8567-4d48-957c-595db40ad072]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kREIuKXs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 16:53:15 user nova-compute[73450]: node.name = iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d
Aug 16 16:53:15 user nova-compute[73450]: node.tpgt = -1
Aug 16 16:53:15 user nova-compute[73450]: node.startup = automatic
Aug 16 16:53:15 user nova-compute[73450]: node.leading_login = No
Aug 16 16:53:15 user nova-compute[73450]: iface.iscsi_ifacename = default
Aug 16 16:53:15 user nova-compute[73450]: iface.net_ifacename = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.ipaddress = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.prefix_len = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.hwaddress = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.transport_name = tcp
Aug 16 16:53:15 user nova-compute[73450]: iface.initiatorname = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.vlan_id = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.vlan_priority = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.vlan_state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.iface_num = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.mtu = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.port = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.bootproto = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.subnet_mask = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.gateway = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_alt_client_id = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_dns = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_learn_iqn = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_vendor_id_state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_vendor_id = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.dhcp_slp_da = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.fragmentation = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.gratuitous_arp = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.incoming_forwarding = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.tos_state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.tos = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.ttl = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.delayed_ack = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.tcp_nagle = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.tcp_wsf_state = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.tcp_wsf = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.tcp_timer_scale = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.tcp_timestamp = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.redirect = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.def_task_mgmt_timeout = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.header_digest = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.data_digest = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.immediate_data = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.initial_r2t = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.data_seq_inorder = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.data_pdu_inorder = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.erl = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.max_receive_data_len = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.first_burst_len = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.max_outstanding_r2t = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.max_burst_len = 0
Aug 16 16:53:15 user nova-compute[73450]: iface.chap_auth = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.bidi_chap = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.strict_login_compliance = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.discovery_auth = <empty>
Aug 16 16:53:15 user nova-compute[73450]: iface.discovery_logout = <empty>
Aug 16 16:53:15 user nova-compute[73450]: node.discovery_address = <empty>
Aug 16 16:53:15 user nova-compute[73450]: node.discovery_port = 0
Aug 16 16:53:15 user nova-compute[73450]: node.discovery_type = static
Aug 16 16:53:15 user nova-compute[73450]: node.session.initial_cmdsn = 0
Aug 16 16:53:15 user nova-compute[73450]: node.session.initial_login_retry_max = 8
Aug 16 16:53:15 user nova-compute[73450]: node.session.xmit_thread_priority = -20
Aug 16 16:53:15 user nova-compute[73450]: node.session.cmds_max = 128
Aug 16 16:53:15 user nova-compute[73450]: node.session.queue_depth = 32
Aug 16 16:53:15 user nova-compute[73450]: node.session.nr_sessions = 1
Aug 16 16:53:15 user nova-compute[73450]: node.session.auth.authmethod = CHAP
Aug 16 16:53:15 user nova-compute[73450]: node.session.auth.username = kREIuKXs
Aug 16 16:53:15 user nova-compute[73450]: node.session.auth.password = ***
Aug 16 16:53:15 user nova-compute[73450]: node.session.auth.username_in = <empty>
Aug 16 16:53:15 user nova-compute[73450]: node.session.auth.password_in = <empty>
Aug 16 16:53:15 user nova-compute[73450]: node.session.auth.chap_algs = MD5
Aug 16 16:53:15 user nova-compute[73450]: node.session.timeo.replacement_timeout = 120
Aug 16 16:53:15 user nova-compute[73450]: node.session.err_timeo.abort_timeout = 15
Aug 16 16:53:15 user nova-compute[73450]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 16:53:15 user nova-compute[73450]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 16:53:15 user nova-compute[73450]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.FastAbort = Yes
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.InitialR2T = No
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.ImmediateData = Yes
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.MaxConnections = 1
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 16:53:15 user nova-compute[73450]: node.session.iscsi.ERL = 0
Aug 16 16:53:15 user nova-compute[73450]: node.session.scan = manual
Aug 16 16:53:15 user nova-compute[73450]: node.session.reopen_max = 0
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].address = 172.16.0.220
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].port = 3260
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].startup = manual
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].tcp.window_size = 524288
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].tcp.type_of_service = 0
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].timeo.logout_timeout = 15
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].timeo.login_timeout = 15
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].timeo.auth_timeout = 45
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].iscsi.DataDigest = None
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].iscsi.IFMarker = No
Aug 16 16:53:15 user nova-compute[73450]: node.conn[0].iscsi.OFMarker = No
Aug 16 16:53:15 user nova-compute[73450]: # END RECORD
Aug 16 16:53:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:53:15 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:15 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:53:15 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:53:15 user nova-compute[73450]:   <serial>d6186f29-4909-467c-be24-505bcc573c2c</serial>
Aug 16 16:53:15 user nova-compute[73450]: </disk>
Aug 16 16:53:15 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab07984-7b06-49e3-beb8-c428e2c549f9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1deb5a5-bb22-432c-b579-a5e84b4f099a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kREIuKXs {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kREIuKXs" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e893104d-ba8d-40e3-b5d0-cf373973a076]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kREIuKXs'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c078ff-bde3-4942-a8d7-b7530446c63c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e8cdff-b3b7-44aa-b9fe-87c81c1b2d98]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)
Aug 16 16:53:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:15 user nova-compute[73450]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)
Aug 16 16:53:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.203s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5bc99-5f75-4eb5-aefa-6861eeda1a3e]: (4, ('0 0 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.230s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== connect_volume: return (560ms) {'type': 'block', 'scsi_wwn': '26161633565366531', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633565366531', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2097810802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2097810802',id=29,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-ujbswy8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:51:49Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=5104e1fc-bcbb-4643-9d66-6f0db4339428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "vif_mac": "fa:16:3e:07:fa:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "vif_mac": "fa:16:3e:07:fa:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.objects.instance [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'pci_devices' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:53:15 user nova-compute[73450]:   <uuid>5104e1fc-bcbb-4643-9d66-6f0db4339428</uuid>
Aug 16 16:53:15 user nova-compute[73450]:   <name>instance-0000001d</name>
Aug 16 16:53:15 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:53:15 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:53:15 user nova-compute[73450]:   <metadata>
Aug 16 16:53:15 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:53:15 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:53:15 user nova-compute[73450]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2097810802</nova:name>
Aug 16 16:53:15 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:53:14</nova:creationTime>
Aug 16 16:53:15 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:53:15 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:53:15 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:53:15 user nova-compute[73450]:       <nova:owner>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:user uuid="3275ae2aaad34aa8adb49e5de0dbe238">tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member</nova:user>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:project uuid="88f813e9d59945b58a7f0141fb29ca46">tempest-ServerBootFromVolumeStableRescueTest-311543227</nova:project>
Aug 16 16:53:15 user nova-compute[73450]:       </nova:owner>
Aug 16 16:53:15 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:53:15 user nova-compute[73450]:       <nova:ports>
Aug 16 16:53:15 user nova-compute[73450]:         <nova:port uuid="ca02a931-7ab6-4e5f-8345-670aea6eedab">
Aug 16 16:53:15 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 16:53:15 user nova-compute[73450]:         </nova:port>
Aug 16 16:53:15 user nova-compute[73450]:       </nova:ports>
Aug 16 16:53:15 user nova-compute[73450]:     </nova:instance>
Aug 16 16:53:15 user nova-compute[73450]:   </metadata>
Aug 16 16:53:15 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:53:15 user nova-compute[73450]:     <system>
Aug 16 16:53:15 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:53:15 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:53:15 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:53:15 user nova-compute[73450]:       <entry name="serial">5104e1fc-bcbb-4643-9d66-6f0db4339428</entry>
Aug 16 16:53:15 user nova-compute[73450]:       <entry name="uuid">5104e1fc-bcbb-4643-9d66-6f0db4339428</entry>
Aug 16 16:53:15 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:53:15 user nova-compute[73450]:     </system>
Aug 16 16:53:15 user nova-compute[73450]:   </sysinfo>
Aug 16 16:53:15 user nova-compute[73450]:   <os>
Aug 16 16:53:15 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:53:15 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:53:15 user nova-compute[73450]:   </os>
Aug 16 16:53:15 user nova-compute[73450]:   <features>
Aug 16 16:53:15 user nova-compute[73450]:     <acpi/>
Aug 16 16:53:15 user nova-compute[73450]:     <apic/>
Aug 16 16:53:15 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:53:15 user nova-compute[73450]:   </features>
Aug 16 16:53:15 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:53:15 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:53:15 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:53:15 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:53:15 user nova-compute[73450]:   </clock>
Aug 16 16:53:15 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:53:15 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:53:15 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:53:15 user nova-compute[73450]:   </cpu>
Aug 16 16:53:15 user nova-compute[73450]:   <devices>
Aug 16 16:53:15 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:53:15 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:15 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 16:53:15 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:53:15 user nova-compute[73450]:       <serial>382bea4f-adac-453a-9c86-539b1d170d4d</serial>
Aug 16 16:53:15 user nova-compute[73450]:     </disk>
Aug 16 16:53:15 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:53:15 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:53:15 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue"/>
Aug 16 16:53:15 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:53:15 user nova-compute[73450]:       <boot order="1"/>
Aug 16 16:53:15 user nova-compute[73450]:     </disk>
Aug 16 16:53:15 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:53:15 user nova-compute[73450]:       <mac address="fa:16:3e:07:fa:9c"/>
Aug 16 16:53:15 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:15 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:53:15 user nova-compute[73450]:       <target dev="tapca02a931-7a"/>
Aug 16 16:53:15 user nova-compute[73450]:     </interface>
Aug 16 16:53:15 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:53:15 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/console.log" append="off"/>
Aug 16 16:53:15 user nova-compute[73450]:     </serial>
Aug 16 16:53:15 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:53:15 user nova-compute[73450]:     <video>
Aug 16 16:53:15 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:15 user nova-compute[73450]:     </video>
Aug 16 16:53:15 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:53:15 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:53:15 user nova-compute[73450]:     </rng>
Aug 16 16:53:15 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:53:15 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:53:15 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:53:15 user nova-compute[73450]:     </memballoon>
Aug 16 16:53:15 user nova-compute[73450]:   </devices>
Aug 16 16:53:15 user nova-compute[73450]: </domain>
Aug 16 16:53:15 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:53:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance destroyed successfully.
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] No VIF found with MAC fa:16:3e:07:fa:9c, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No VIF found with MAC fa:16:3e:60:ff:4b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-45044423-1316-495a-a4e3-abead3689206 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.840s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-9fc4aca2-20e8-4b7a-a7d7-b14c1c1f0b0d req-edcbdf0d-cfb7-46b4-900c-2e48c3f41bbb service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9fc4aca2-20e8-4b7a-a7d7-b14c1c1f0b0d req-edcbdf0d-cfb7-46b4-900c-2e48c3f41bbb service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9fc4aca2-20e8-4b7a-a7d7-b14c1c1f0b0d req-edcbdf0d-cfb7-46b4-900c-2e48c3f41bbb service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9fc4aca2-20e8-4b7a-a7d7-b14c1c1f0b0d req-edcbdf0d-cfb7-46b4-900c-2e48c3f41bbb service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-9fc4aca2-20e8-4b7a-a7d7-b14c1c1f0b0d req-edcbdf0d-cfb7-46b4-900c-2e48c3f41bbb service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:17 user nova-compute[73450]: WARNING nova.compute.manager [req-9fc4aca2-20e8-4b7a-a7d7-b14c1c1f0b0d req-edcbdf0d-cfb7-46b4-900c-2e48c3f41bbb service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state rescuing.
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:18 user nova-compute[73450]: INFO nova.compute.manager [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Detaching volume d6186f29-4909-467c-be24-505bcc573c2c
Aug 16 16:53:18 user nova-compute[73450]: INFO nova.virt.block_device [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attempting to driver detach volume d6186f29-4909-467c-be24-505bcc573c2c from mountpoint /dev/vdb
Aug 16 16:53:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Attempting to detach device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:53:18 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:18 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:53:18 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:53:18 user nova-compute[73450]:   <serial>d6186f29-4909-467c-be24-505bcc573c2c</serial>
Aug 16 16:53:18 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:53:18 user nova-compute[73450]: </disk>
Aug 16 16:53:18 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:53:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config.
Aug 16 16:53:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:53:18 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:18 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:53:18 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:53:18 user nova-compute[73450]:   <serial>d6186f29-4909-467c-be24-505bcc573c2c</serial>
Aug 16 16:53:18 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:53:18 user nova-compute[73450]: </disk>
Aug 16 16:53:18 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG nova.objects.instance [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'flavor' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:19 user nova-compute[73450]: INFO nova.compute.manager [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Attaching volume 9ddb0f9c-cfe2-452a-8147-969df0c68d45 to /dev/vdb
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204799.1109233, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:53:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config.
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoyhVSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:19 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc18aa0-c1e2-4539-8326-3571da6a1155]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.utils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa800c-e75c-4dc7-a4cd-8de867abd9c4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)
Aug 16 16:53:19 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:19 user nova-compute[73450]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c (non-flash)
Aug 16 16:53:19 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270784550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e76e727-9512-4c93-8986-6f5e08135f2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1055d223-617d-4784-b1cd-ecbf44b42c8b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db91c3a-49b7-41d5-be4c-16364a8e3ae2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f4d3a-2a49-460b-8e1d-64c43683cd72]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1207209-ff6f-46e3-b8e1-dd72e7edfcb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5f7c7a-4463-4d30-920c-ceaeca2347d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb7bf5-5cbc-46b3-b597-e08fe754f638]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:53:19 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[827416d8-2a96-45d8-986d-d2a83edd03c2]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.utils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating existing volume attachment record: c13c4d5f-fe62-44e8-bb51-79128af59a78 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471e1b9-fe46-4437-af92-540a65588c94]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f69bb5-9f74-4ecc-843a-39a4473ed988]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eec158-4693-425d-80ee-dcaf82dc1294]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260]
Aug 16 16:53:19 user nova-compute[73450]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:19 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6186f29-4909-467c-be24-505bcc573c2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae35e95-21f6-4c8f-a505-91978dc87d84]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== disconnect_volume: return (394ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 5104e1fc-bcbb-4643-9d66-6f0db4339428 due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204799.8246052, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Resumed (Lifecycle Event)
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-899f6f97-2826-44f9-b08a-0d73f4dc426f tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204799.8260713, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Started (Lifecycle Event)
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:53:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f68d8df-a443-4669-8a3b-ed8bf8c72b8f req-b43dda7d-1945-49d3-9213-157d1912db8f service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f68d8df-a443-4669-8a3b-ed8bf8c72b8f req-b43dda7d-1945-49d3-9213-157d1912db8f service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f68d8df-a443-4669-8a3b-ed8bf8c72b8f req-b43dda7d-1945-49d3-9213-157d1912db8f service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5f68d8df-a443-4669-8a3b-ed8bf8c72b8f req-b43dda7d-1945-49d3-9213-157d1912db8f service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-5f68d8df-a443-4669-8a3b-ed8bf8c72b8f req-b43dda7d-1945-49d3-9213-157d1912db8f service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:20 user nova-compute[73450]: WARNING nova.compute.manager [req-5f68d8df-a443-4669-8a3b-ed8bf8c72b8f req-b43dda7d-1945-49d3-9213-157d1912db8f service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state rescued and task_state None.
Aug 16 16:53:20 user nova-compute[73450]: DEBUG nova.objects.instance [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-51b086e7-cc60-43d2-94e1-76c69db65a5a tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.933s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-changed-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Refreshing instance network info cache due to event network-changed-bd4045fc-71f0-402d-bc5c-cd447d7731a6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] Acquiring lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] Acquired lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Refreshing network info cache for port bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updated VIF entry in instance network info cache for port bd4045fc-71f0-402d-bc5c-cd447d7731a6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updating instance_info_cache with network_info: [{"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-49da02db-37a9-42ed-93d7-38dad59b2752 req-ce59fb8c-6654-4ddd-a24a-2ebb6df91dfb service nova] Releasing lock "refresh_cache-9a63d50d-5b5b-401e-b6fc-960008baca37" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:31 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:31 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:31 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c72f8ed-1d0c-4c9c-86f6-d43b2cae4c31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:53:31 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb7bb5-6604-48dc-ad8c-daa82b722db2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45] added
Aug 16 16:53:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b86fb64-50d0-41b2-9f5e-db93ca36ce64]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b58422-4b82-488c-a7ac-c7858221d88e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyHxmMGd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyHxmMGd" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a35793f-b385-4a28-8bbe-ebd8a16dd8fd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyHxmMGd'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66c9988-ed3a-499e-9d07-b3cc4054b311]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7feae6-b591-4465-8e60-10fd18bc3ed1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:31 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:31 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:31 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:31 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:31 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:31 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5447dae3-5f18-4a09-a5f2-a94090ba51fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]
Aug 16 16:53:31 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87ad4bd-3ec7-41c2-af23-e5d7105e7d9a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b493f73a-dd8d-4c01-8b89-9c7abfb0fa96]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:32 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfc5d72-dbaf-4660-aa44-b31b1c93de46]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:53:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26537326265313861', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537326265313861', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'flavor' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:53:33 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:33 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:53:33 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:53:33 user nova-compute[73450]:   <serial>9ddb0f9c-cfe2-452a-8147-969df0c68d45</serial>
Aug 16 16:53:33 user nova-compute[73450]: </disk>
Aug 16 16:53:33 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No VIF found with MAC fa:16:3e:c8:de:4f, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-20e1fa88-69cb-4dcf-a15a-98645cd7cd3c tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.722s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:53:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:35 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:53:35 user nova-compute[73450]: INFO nova.compute.claims [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Claim successful on node user
Aug 16 16:53:35 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:53:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.policy [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ad6596f3b24060afcb46a826b225dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f7ffafeb9540018858b70f436caf82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:53:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Creating image(s)
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "/opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "/opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.238s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk 1073741824" returned: 0 in 0.055s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Successfully created port: 15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.230s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Cannot resize image /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'migration_context' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Ensure instance console log exists: /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:53:37 user nova-compute[73450]: INFO nova.compute.claims [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Claim successful on node user
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Successfully updated port: 15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquired lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-changed-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Refreshing instance network info cache due to event network-changed-15a4b383-d9ed-4548-a49d-a509a177e33c. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] Acquiring lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:53:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:53:38 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:53:38 user nova-compute[73450]: INFO nova.virt.block_device [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Booting with volume snapshot 416b43ee-8cc5-4517-a52d-ca9e38473b9e at /dev/vda
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.policy [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c95d246b43b45b4963f9d750ae89fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b953d82d634106aa0fb9574fafdc0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updating instance_info_cache with network_info: [{"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Releasing lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Instance network_info: |[{"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] Acquired lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Refreshing network info cache for port 15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Start _get_guest_xml network_info=[{"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:53:38 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:38 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1027793632',display_name='tempest-TestServerVolumeAttachmentScenario-server-1027793632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1027793632',id=33,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFx6JYupBcCGkDepX7s644n5ZGdokBugjXd++Cv4v/rmXH0dLf0MRR3ezsl4iM/A+ZBrrbBQDEvtABvrYzAGdrLxN6a62It/ZN0qo7l9e6p1oMegEUGhNjBEpKcQDN/A==',key_name='tempest-keypair-1716247603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f7ffafeb9540018858b70f436caf82',ramdisk_id='',reservation_id='r-oeo8gks0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-599690406',owner_user_name='tempest-TestServerVolumeAttachmentScenario-599690406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ad6596f3b24060afcb46a826b225dd',uuid=f0740cc8-0435-43d3-8e8d-c0b05240947e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Converting VIF {"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'pci_devices' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:53:38 user nova-compute[73450]:   <uuid>f0740cc8-0435-43d3-8e8d-c0b05240947e</uuid>
Aug 16 16:53:38 user nova-compute[73450]:   <name>instance-00000021</name>
Aug 16 16:53:38 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:53:38 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:53:38 user nova-compute[73450]:   <metadata>
Aug 16 16:53:38 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:53:38 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:53:38 user nova-compute[73450]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1027793632</nova:name>
Aug 16 16:53:38 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:53:38</nova:creationTime>
Aug 16 16:53:38 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:53:38 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:53:38 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:53:38 user nova-compute[73450]:       <nova:owner>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:user uuid="05ad6596f3b24060afcb46a826b225dd">tempest-TestServerVolumeAttachmentScenario-599690406-project-member</nova:user>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:project uuid="39f7ffafeb9540018858b70f436caf82">tempest-TestServerVolumeAttachmentScenario-599690406</nova:project>
Aug 16 16:53:38 user nova-compute[73450]:       </nova:owner>
Aug 16 16:53:38 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:53:38 user nova-compute[73450]:       <nova:ports>
Aug 16 16:53:38 user nova-compute[73450]:         <nova:port uuid="15a4b383-d9ed-4548-a49d-a509a177e33c">
Aug 16 16:53:38 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 16:53:38 user nova-compute[73450]:         </nova:port>
Aug 16 16:53:38 user nova-compute[73450]:       </nova:ports>
Aug 16 16:53:38 user nova-compute[73450]:     </nova:instance>
Aug 16 16:53:38 user nova-compute[73450]:   </metadata>
Aug 16 16:53:38 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:53:38 user nova-compute[73450]:     <system>
Aug 16 16:53:38 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:53:38 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:53:38 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:53:38 user nova-compute[73450]:       <entry name="serial">f0740cc8-0435-43d3-8e8d-c0b05240947e</entry>
Aug 16 16:53:38 user nova-compute[73450]:       <entry name="uuid">f0740cc8-0435-43d3-8e8d-c0b05240947e</entry>
Aug 16 16:53:38 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:53:38 user nova-compute[73450]:     </system>
Aug 16 16:53:38 user nova-compute[73450]:   </sysinfo>
Aug 16 16:53:38 user nova-compute[73450]:   <os>
Aug 16 16:53:38 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:53:38 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:53:38 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:53:38 user nova-compute[73450]:   </os>
Aug 16 16:53:38 user nova-compute[73450]:   <features>
Aug 16 16:53:38 user nova-compute[73450]:     <acpi/>
Aug 16 16:53:38 user nova-compute[73450]:     <apic/>
Aug 16 16:53:38 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:53:38 user nova-compute[73450]:   </features>
Aug 16 16:53:38 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:53:38 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:53:38 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:53:38 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:53:38 user nova-compute[73450]:   </clock>
Aug 16 16:53:38 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:53:38 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:53:38 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:53:38 user nova-compute[73450]:   </cpu>
Aug 16 16:53:38 user nova-compute[73450]:   <devices>
Aug 16 16:53:38 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:53:38 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:53:38 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk"/>
Aug 16 16:53:38 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:53:38 user nova-compute[73450]:     </disk>
Aug 16 16:53:38 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:53:38 user nova-compute[73450]:       <mac address="fa:16:3e:1e:e1:66"/>
Aug 16 16:53:38 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:38 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:53:38 user nova-compute[73450]:       <target dev="tap15a4b383-d9"/>
Aug 16 16:53:38 user nova-compute[73450]:     </interface>
Aug 16 16:53:38 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:53:38 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/console.log" append="off"/>
Aug 16 16:53:38 user nova-compute[73450]:     </serial>
Aug 16 16:53:38 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:53:38 user nova-compute[73450]:     <video>
Aug 16 16:53:38 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:38 user nova-compute[73450]:     </video>
Aug 16 16:53:38 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:53:38 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:53:38 user nova-compute[73450]:     </rng>
Aug 16 16:53:38 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:53:38 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:53:38 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:53:38 user nova-compute[73450]:     </memballoon>
Aug 16 16:53:38 user nova-compute[73450]:   </devices>
Aug 16 16:53:38 user nova-compute[73450]: </domain>
Aug 16 16:53:38 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1027793632',display_name='tempest-TestServerVolumeAttachmentScenario-server-1027793632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1027793632',id=33,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFx6JYupBcCGkDepX7s644n5ZGdokBugjXd++Cv4v/rmXH0dLf0MRR3ezsl4iM/A+ZBrrbBQDEvtABvrYzAGdrLxN6a62It/ZN0qo7l9e6p1oMegEUGhNjBEpKcQDN/A==',key_name='tempest-keypair-1716247603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f7ffafeb9540018858b70f436caf82',ramdisk_id='',reservation_id='r-oeo8gks0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-599690406',owner_user_name='tempest-TestServerVolumeAttachmentScenario-599690406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ad6596f3b24060afcb46a826b225dd',uuid=f0740cc8-0435-43d3-8e8d-c0b05240947e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Converting VIF {"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG os_vif [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15a4b383-d9, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15a4b383-d9, col_values=(('external_ids', {'iface-id': '15a4b383-d9ed-4548-a49d-a509a177e33c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:e1:66', 'vm-uuid': 'f0740cc8-0435-43d3-8e8d-c0b05240947e'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:38 user nova-compute[73450]: INFO os_vif [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9')
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No VIF found with MAC fa:16:3e:1e:e1:66, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Successfully created port: a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updated VIF entry in instance network info cache for port 15a4b383-d9ed-4548-a49d-a509a177e33c. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updating instance_info_cache with network_info: [{"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-81c67463-72e4-4791-81e0-8620acc33528 req-d1a2af94-8b3e-48fb-8e07-c7b5f67c7aeb service nova] Releasing lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Successfully updated port: a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquired lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-changed-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Refreshing instance network info cache due to event network-changed-a3323a8e-6558-4091-861e-d4e943ca0bd2. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] Acquiring lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:53:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG nova.network.neutron [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updating instance_info_cache with network_info: [{"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Releasing lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Instance network_info: |[{"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] Acquired lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Refreshing network info cache for port a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updated VIF entry in instance network info cache for port a3323a8e-6558-4091-861e-d4e943ca0bd2. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updating instance_info_cache with network_info: [{"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-15078eb0-5500-47fa-8eeb-3ee4a8fc439c req-4dc1c250-cdee-4a89-8d67-3b7c79f90e02 service nova] Releasing lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] No waiting events found dispatching network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:41 user nova-compute[73450]: WARNING nova.compute.manager [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received unexpected event network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c for instance with vm_state building and task_state spawning.
Aug 16 16:53:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] No waiting events found dispatching network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:41 user nova-compute[73450]: WARNING nova.compute.manager [req-f3fe53c9-8e73-4255-87e9-619c0b3d59cc req-4a49f720-4603-4ccc-911f-d5bd60e4b5d4 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received unexpected event network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c for instance with vm_state building and task_state spawning.
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204822.2559786, f0740cc8-0435-43d3-8e8d-c0b05240947e => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] VM Resumed (Lifecycle Event)
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Instance spawned successfully.
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204822.2572248, f0740cc8-0435-43d3-8e8d-c0b05240947e => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] VM Started (Lifecycle Event)
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 16 16:53:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:42 user nova-compute[73450]: INFO nova.compute.manager [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Took 6.97 seconds to build instance.
Aug 16 16:53:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7d865243-9ab0-4139-92b7-4f71c8082df7 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.071s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG os_brick.utils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff98e1c-efff-423a-bc11-b3ea4d0034a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331a589-8abe-40d0-9954-fcc74ef42759]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605a24f-623e-430d-aaf7-0de878426fa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19c148-5d82-4d36-a7be-eee1e67a1a2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:53:44 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:53:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19de82d-f960-4d7e-8804-eeac2cb68969]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG os_brick.utils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updating existing volume attachment record: 08a85461-382e-4ed4-9837-99a7bf3e9945 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:53:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing instance network info cache due to event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:53:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:53:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updated VIF entry in instance network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:53:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-19a3dc0a-e9f1-422f-bc64-8f394b15c013 req-7c9a07e1-9b1d-493a-921a-965f180a22e5 service nova] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing instance network info cache due to event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [{"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-767812ec-7b5d-414e-ae14-a0bb1ccfb13b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:53:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updated VIF entry in instance network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:53:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-53a69fbd-704c-4f2d-a7eb-f30826d5324d req-4748c9a1-1bdb-4dc0-9db9-25d9285e8352 service nova] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:56 user nova-compute[73450]: INFO nova.compute.manager [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Rebooting instance
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:53:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Creating image(s)
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Ensure instance console log exists: /opt/stack/data/nova/instances/9c32b066-e018-4db3-8b62-22aa7a3838c2/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Start _get_guest_xml network_info=[{"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T16:53:25Z,direct_url=<?>,disk_format='qcow2',id=1feff467-a080-43ad-a1eb-9dbe35f35f93,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1928900659',owner='a3b953d82d634106aa0fb9574fafdc0d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T16:53:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '08a85461-382e-4ed4-9837-99a7bf3e9945', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuQHTRqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c32b066-e018-4db3-8b62-22aa7a3838c2', 'attached_at': '', 'detached_at': '', 'volume_id': '0fd8bc66-74c7-44d7-8a2f-edcde9f8c165', 'serial': '0fd8bc66-74c7-44d7-8a2f-edcde9f8c165'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:53:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:56 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T16:53:25Z,direct_url=<?>,disk_format='qcow2',id=1feff467-a080-43ad-a1eb-9dbe35f35f93,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1928900659',owner='a3b953d82d634106aa0fb9574fafdc0d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T16:53:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuQHTRqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:56 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:56 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:56 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9110bb2e-c548-402f-9cdc-f5dce303fa09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:53:56 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f492e1d-ff4f-4651-a867-2ef33186f66f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165] added
Aug 16 16:53:56 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef85bcd-4373-42aa-9d65-c7a1835cdd33]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d7f07-73db-4b63-994d-8c916a79dca5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuQHTRqw {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuQHTRqw" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c773e1-ec9b-4f60-8552-8405b8ce3815]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KuQHTRqw'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf8f8e-2c69-44c5-949b-e1dc2a17cd8a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9873923d-3089-41ff-9b28-6f0d8c711e29]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:56 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:56 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:56 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4665d06b-13c7-4009-9916-01aa3534e744]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260]
Aug 16 16:53:56 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:56 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b991ada2-7d7b-40ad-91a2-6c81b3c8a77d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49986c-47c1-4f5e-a341-27fe8c615061]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:57 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e7e97-e1bb-453a-8b04-cf8238bfcf03]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuQHTRqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.890s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== connect_volume: return (1892ms) {'type': 'block', 'scsi_wwn': '23531653561313761', 'path': '/dev/sdf'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531653561313761', 'path': '/dev/sdf'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-f7bd6fb6-5314-4136-8078-431edaa780f1 req-cc6d7c5f-eb5a-4490-9123-95c1a1337d38 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-unplugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f7bd6fb6-5314-4136-8078-431edaa780f1 req-cc6d7c5f-eb5a-4490-9123-95c1a1337d38 service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f7bd6fb6-5314-4136-8078-431edaa780f1 req-cc6d7c5f-eb5a-4490-9123-95c1a1337d38 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f7bd6fb6-5314-4136-8078-431edaa780f1 req-cc6d7c5f-eb5a-4490-9123-95c1a1337d38 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-f7bd6fb6-5314-4136-8078-431edaa780f1 req-cc6d7c5f-eb5a-4490-9123-95c1a1337d38 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-unplugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:58 user nova-compute[73450]: WARNING nova.compute.manager [req-f7bd6fb6-5314-4136-8078-431edaa780f1 req-cc6d7c5f-eb5a-4490-9123-95c1a1337d38 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-unplugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:58 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7031MB free_disk=23.724365234375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:58 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance destroyed successfully.
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.objects.instance [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'resources' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167881879',display_name='tempest-TestMinimumBasicScenario-server-1167881879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167881879',id=30,image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvpuiF/GcK+jBYxfRiaZkIdPRIBolZ2O5+5duCiC4VDIg25CdFE52GrAtZgEdNyH9sNHH9uY4Lr0Pt3q/cMXVrSYvduWJYWl2r4RGsnGkMi+BprC8rFWeVSXAHrxuvnFw==',key_name='tempest-TestMinimumBasicScenario-20692004',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-1vfwhcwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:53:57Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=cfe56b3e-2553-4a80-990b-974d4a8d84a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1293876104',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1293876104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1293876104',id=34,image_ref='1feff467-a080-43ad-a1eb-9dbe35f35f93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtoOqlt5hzwf1j6qDwk6r/4dBk/1L9znI0nhApRrPmPbjrIi1cPxYHMPjqNVASjNWTdRoKcasiiPzSEGTTNA1IjZofjnMKJNWBAaDmoTnDE1jw9UIElL4Q/T0Yzs+Dh0A==',key_name='tempest-keypair-1874210094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-q40e3a86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-717711848',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=9c32b066-e018-4db3-8b62-22aa7a3838c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c32b066-e018-4db3-8b62-22aa7a3838c2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad991858-4f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:53:58 user nova-compute[73450]:   <uuid>9c32b066-e018-4db3-8b62-22aa7a3838c2</uuid>
Aug 16 16:53:58 user nova-compute[73450]:   <name>instance-00000022</name>
Aug 16 16:53:58 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:53:58 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:53:58 user nova-compute[73450]:   <metadata>
Aug 16 16:53:58 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:53:58 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:53:58 user nova-compute[73450]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1293876104</nova:name>
Aug 16 16:53:58 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:53:56</nova:creationTime>
Aug 16 16:53:58 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:53:58 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:53:58 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:53:58 user nova-compute[73450]:       <nova:owner>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:user uuid="8c95d246b43b45b4963f9d750ae89fbd">tempest-TestVolumeBootPattern-717711848-project-member</nova:user>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:project uuid="a3b953d82d634106aa0fb9574fafdc0d">tempest-TestVolumeBootPattern-717711848</nova:project>
Aug 16 16:53:58 user nova-compute[73450]:       </nova:owner>
Aug 16 16:53:58 user nova-compute[73450]:       <nova:root type="image" uuid="1feff467-a080-43ad-a1eb-9dbe35f35f93"/>
Aug 16 16:53:58 user nova-compute[73450]:       <nova:ports>
Aug 16 16:53:58 user nova-compute[73450]:         <nova:port uuid="a3323a8e-6558-4091-861e-d4e943ca0bd2">
Aug 16 16:53:58 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 16:53:58 user nova-compute[73450]:         </nova:port>
Aug 16 16:53:58 user nova-compute[73450]:       </nova:ports>
Aug 16 16:53:58 user nova-compute[73450]:     </nova:instance>
Aug 16 16:53:58 user nova-compute[73450]:   </metadata>
Aug 16 16:53:58 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:53:58 user nova-compute[73450]:     <system>
Aug 16 16:53:58 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:53:58 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:53:58 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:53:58 user nova-compute[73450]:       <entry name="serial">9c32b066-e018-4db3-8b62-22aa7a3838c2</entry>
Aug 16 16:53:58 user nova-compute[73450]:       <entry name="uuid">9c32b066-e018-4db3-8b62-22aa7a3838c2</entry>
Aug 16 16:53:58 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:53:58 user nova-compute[73450]:     </system>
Aug 16 16:53:58 user nova-compute[73450]:   </sysinfo>
Aug 16 16:53:58 user nova-compute[73450]:   <os>
Aug 16 16:53:58 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:53:58 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:53:58 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:53:58 user nova-compute[73450]:   </os>
Aug 16 16:53:58 user nova-compute[73450]:   <features>
Aug 16 16:53:58 user nova-compute[73450]:     <acpi/>
Aug 16 16:53:58 user nova-compute[73450]:     <apic/>
Aug 16 16:53:58 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:53:58 user nova-compute[73450]:   </features>
Aug 16 16:53:58 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:53:58 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:53:58 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:53:58 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:53:58 user nova-compute[73450]:   </clock>
Aug 16 16:53:58 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:53:58 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:53:58 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:53:58 user nova-compute[73450]:   </cpu>
Aug 16 16:53:58 user nova-compute[73450]:   <devices>
Aug 16 16:53:58 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:53:58 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:53:58 user nova-compute[73450]:       <source dev="/dev/sdf"/>
Aug 16 16:53:58 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:53:58 user nova-compute[73450]:       <serial>0fd8bc66-74c7-44d7-8a2f-edcde9f8c165</serial>
Aug 16 16:53:58 user nova-compute[73450]:     </disk>
Aug 16 16:53:58 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:53:58 user nova-compute[73450]:       <mac address="fa:16:3e:38:b9:fe"/>
Aug 16 16:53:58 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:58 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:53:58 user nova-compute[73450]:       <target dev="tapa3323a8e-65"/>
Aug 16 16:53:58 user nova-compute[73450]:     </interface>
Aug 16 16:53:58 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:53:58 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/9c32b066-e018-4db3-8b62-22aa7a3838c2/console.log" append="off"/>
Aug 16 16:53:58 user nova-compute[73450]:     </serial>
Aug 16 16:53:58 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:53:58 user nova-compute[73450]:     <video>
Aug 16 16:53:58 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:53:58 user nova-compute[73450]:     </video>
Aug 16 16:53:58 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:53:58 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:53:58 user nova-compute[73450]:     </rng>
Aug 16 16:53:58 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:53:58 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:53:58 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:53:58 user nova-compute[73450]:     </memballoon>
Aug 16 16:53:58 user nova-compute[73450]:   </devices>
Aug 16 16:53:58 user nova-compute[73450]: </domain>
Aug 16 16:53:58 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1293876104',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1293876104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1293876104',id=34,image_ref='1feff467-a080-43ad-a1eb-9dbe35f35f93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtoOqlt5hzwf1j6qDwk6r/4dBk/1L9znI0nhApRrPmPbjrIi1cPxYHMPjqNVASjNWTdRoKcasiiPzSEGTTNA1IjZofjnMKJNWBAaDmoTnDE1jw9UIElL4Q/T0Yzs+Dh0A==',key_name='tempest-keypair-1874210094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-q40e3a86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-717711848',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=9c32b066-e018-4db3-8b62-22aa7a3838c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_vif [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:53:58 user nova-compute[73450]: INFO os_vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f')
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3323a8e-65, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3323a8e-65, col_values=(('external_ids', {'iface-id': 'a3323a8e-6558-4091-861e-d4e943ca0bd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:b9:fe', 'vm-uuid': '9c32b066-e018-4db3-8b62-22aa7a3838c2'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:58 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:58 user nova-compute[73450]: INFO os_vif [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65')
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59cb26f-9868-4f69-ab16-2e7e8bddc142]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No VIF found with MAC fa:16:3e:38:b9:fe, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cc6ed5-0fa2-4606-b1a8-33c29e1b1e40]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:58 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270133eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a36f0a56-ed4a-4593-8c78-f71a53938fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5104e1fc-bcbb-4643-9d66-6f0db4339428 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9a63d50d-5b5b-401e-b6fc-960008baca37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032b05e3-0db8-4029-9764-9fcce2eb55a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance f0740cc8-0435-43d3-8e8d-c0b05240947e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9c32b066-e018-4db3-8b62-22aa7a3838c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665bca6-f135-4891-ab1d-9dba508480f2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6cded1-6be7-448f-8c94-0af47c8fcd77]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[33169e66-b5f2-42dc-ac28-626f456d9907]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa15e5b-3bcb-435f-aa25-5424cab4155e]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5c25cb-501b-4c1e-a90c-3f65fbd17d82]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[73113706-0f10-4263-8d65-1559afa18ba5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]
Aug 16 16:53:58 user nova-compute[73450]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1ed2d-c825-4d13-bc89-21138c3ba1f3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== disconnect_volume: return (331ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Start _get_guest_xml network_info=[{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a957b4-d282-4a04-bbe6-aeef51b5d19a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': '68a957b4-d282-4a04-bbe6-aeef51b5d19a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c13c4d5f-fe62-44e8-bb51-79128af59a78', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cfe56b3e-2553-4a80-990b-974d4a8d84a1', 'attached_at': '', 'detached_at': '', 'volume_id': '9ddb0f9c-cfe2-452a-8147-969df0c68d45', 'serial': '9ddb0f9c-cfe2-452a-8147-969df0c68d45'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:53:58 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:58 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:53:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a957b4-d282-4a04-bbe6-aeef51b5d19a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.objects.instance [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:53:59 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:59 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:53:59 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8e69a-828d-4120-8686-d0d39ec3e3cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:53:59 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b47096-28d4-4ebb-95ef-a4f6fadd0852]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45] added
Aug 16 16:53:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7a5151-5018-4fcd-907c-f37de5b47fda]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88756a1-c2e2-43dc-b53b-9a1e12c8b2e0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyHxmMGd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyHxmMGd" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f662a5-cef1-49e6-92b1-d5fc5b07ddb1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyHxmMGd'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[352067a6-e805-4a96-bec5-2be9ad799d89]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d18c5-e4df-4ab3-8189-563543679c68]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec473bc4-9568-4291-8f29-8542b6193839]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]
Aug 16 16:53:59 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.
Aug 16 16:53:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1aff4e-ae08-47bc-ac19-aba3d60d9e8b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879082b-aff0-4f28-8eee-580a25dddc17]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:53:59 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:53:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9554d1-5348-4e10-8cb3-4e2989c99c8b]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-7de6c3c1-7136-4d2f-872a-949298e82383 req-b437a69d-8497-46c4-96ad-d1329d835f67 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7de6c3c1-7136-4d2f-872a-949298e82383 req-b437a69d-8497-46c4-96ad-d1329d835f67 service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7de6c3c1-7136-4d2f-872a-949298e82383 req-b437a69d-8497-46c4-96ad-d1329d835f67 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7de6c3c1-7136-4d2f-872a-949298e82383 req-b437a69d-8497-46c4-96ad-d1329d835f67 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-7de6c3c1-7136-4d2f-872a-949298e82383 req-b437a69d-8497-46c4-96ad-d1329d835f67 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:53:59 user nova-compute[73450]: WARNING nova.compute.manager [req-7de6c3c1-7136-4d2f-872a-949298e82383 req-b437a69d-8497-46c4-96ad-d1329d835f67 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 16:53:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:53:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-a96289e8-b564-46eb-a99c-b503ca860df3 req-4b855bd0-7efc-49c9-b7d6-d1a1c5bf25a6 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a96289e8-b564-46eb-a99c-b503ca860df3 req-4b855bd0-7efc-49c9-b7d6-d1a1c5bf25a6 service nova] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a96289e8-b564-46eb-a99c-b503ca860df3 req-4b855bd0-7efc-49c9-b7d6-d1a1c5bf25a6 service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a96289e8-b564-46eb-a99c-b503ca860df3 req-4b855bd0-7efc-49c9-b7d6-d1a1c5bf25a6 service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-a96289e8-b564-46eb-a99c-b503ca860df3 req-4b855bd0-7efc-49c9-b7d6-d1a1c5bf25a6 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] No waiting events found dispatching network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:00 user nova-compute[73450]: WARNING nova.compute.manager [req-a96289e8-b564-46eb-a99c-b503ca860df3 req-4b855bd0-7efc-49c9-b7d6-d1a1c5bf25a6 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received unexpected event network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 for instance with vm_state building and task_state spawning.
Aug 16 16:54:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26537326265313861', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537326265313861', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167881879',display_name='tempest-TestMinimumBasicScenario-server-1167881879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167881879',id=30,image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvpuiF/GcK+jBYxfRiaZkIdPRIBolZ2O5+5duCiC4VDIg25CdFE52GrAtZgEdNyH9sNHH9uY4Lr0Pt3q/cMXVrSYvduWJYWl2r4RGsnGkMi+BprC8rFWeVSXAHrxuvnFw==',key_name='tempest-TestMinimumBasicScenario-20692004',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-1vfwhcwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:53:57Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=cfe56b3e-2553-4a80-990b-974d4a8d84a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'pci_devices' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:54:00 user nova-compute[73450]:   <uuid>cfe56b3e-2553-4a80-990b-974d4a8d84a1</uuid>
Aug 16 16:54:00 user nova-compute[73450]:   <name>instance-0000001e</name>
Aug 16 16:54:00 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:54:00 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:54:00 user nova-compute[73450]:   <metadata>
Aug 16 16:54:00 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:54:00 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:54:00 user nova-compute[73450]:       <nova:name>tempest-TestMinimumBasicScenario-server-1167881879</nova:name>
Aug 16 16:54:00 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:53:58</nova:creationTime>
Aug 16 16:54:00 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:54:00 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:54:00 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:54:00 user nova-compute[73450]:       <nova:owner>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:user uuid="5076f53f390e4fc4b69fe0aa206a916c">tempest-TestMinimumBasicScenario-1533627500-project-member</nova:user>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:project uuid="4ee3a81531b34430b14fad85fe6c400c">tempest-TestMinimumBasicScenario-1533627500</nova:project>
Aug 16 16:54:00 user nova-compute[73450]:       </nova:owner>
Aug 16 16:54:00 user nova-compute[73450]:       <nova:root type="image" uuid="68a957b4-d282-4a04-bbe6-aeef51b5d19a"/>
Aug 16 16:54:00 user nova-compute[73450]:       <nova:ports>
Aug 16 16:54:00 user nova-compute[73450]:         <nova:port uuid="ad991858-4f5a-4176-99b9-fcc0c75c91b4">
Aug 16 16:54:00 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:54:00 user nova-compute[73450]:         </nova:port>
Aug 16 16:54:00 user nova-compute[73450]:       </nova:ports>
Aug 16 16:54:00 user nova-compute[73450]:     </nova:instance>
Aug 16 16:54:00 user nova-compute[73450]:   </metadata>
Aug 16 16:54:00 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:54:00 user nova-compute[73450]:     <system>
Aug 16 16:54:00 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:54:00 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:54:00 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:54:00 user nova-compute[73450]:       <entry name="serial">cfe56b3e-2553-4a80-990b-974d4a8d84a1</entry>
Aug 16 16:54:00 user nova-compute[73450]:       <entry name="uuid">cfe56b3e-2553-4a80-990b-974d4a8d84a1</entry>
Aug 16 16:54:00 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:54:00 user nova-compute[73450]:     </system>
Aug 16 16:54:00 user nova-compute[73450]:   </sysinfo>
Aug 16 16:54:00 user nova-compute[73450]:   <os>
Aug 16 16:54:00 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:54:00 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:54:00 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:54:00 user nova-compute[73450]:   </os>
Aug 16 16:54:00 user nova-compute[73450]:   <features>
Aug 16 16:54:00 user nova-compute[73450]:     <acpi/>
Aug 16 16:54:00 user nova-compute[73450]:     <apic/>
Aug 16 16:54:00 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:54:00 user nova-compute[73450]:   </features>
Aug 16 16:54:00 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:54:00 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:54:00 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:54:00 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:54:00 user nova-compute[73450]:   </clock>
Aug 16 16:54:00 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:54:00 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:54:00 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:54:00 user nova-compute[73450]:   </cpu>
Aug 16 16:54:00 user nova-compute[73450]:   <devices>
Aug 16 16:54:00 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:54:00 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:54:00 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk"/>
Aug 16 16:54:00 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:54:00 user nova-compute[73450]:     </disk>
Aug 16 16:54:00 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:54:00 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:54:00 user nova-compute[73450]:       <source dev="/dev/sde"/>
Aug 16 16:54:00 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 16:54:00 user nova-compute[73450]:       <serial>9ddb0f9c-cfe2-452a-8147-969df0c68d45</serial>
Aug 16 16:54:00 user nova-compute[73450]:     </disk>
Aug 16 16:54:00 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:54:00 user nova-compute[73450]:       <mac address="fa:16:3e:c8:de:4f"/>
Aug 16 16:54:00 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:54:00 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:54:00 user nova-compute[73450]:       <target dev="tapad991858-4f"/>
Aug 16 16:54:00 user nova-compute[73450]:     </interface>
Aug 16 16:54:00 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:54:00 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/console.log" append="off"/>
Aug 16 16:54:00 user nova-compute[73450]:     </serial>
Aug 16 16:54:00 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:54:00 user nova-compute[73450]:     <video>
Aug 16 16:54:00 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:54:00 user nova-compute[73450]:     </video>
Aug 16 16:54:00 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:54:00 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:54:00 user nova-compute[73450]:     </rng>
Aug 16 16:54:00 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:54:00 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:54:00 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:54:00 user nova-compute[73450]:     </memballoon>
Aug 16 16:54:00 user nova-compute[73450]:   </devices>
Aug 16 16:54:00 user nova-compute[73450]: </domain>
Aug 16 16:54:00 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91 --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Cannot resize image /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'migration_context' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167881879',display_name='tempest-TestMinimumBasicScenario-server-1167881879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167881879',id=30,image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvpuiF/GcK+jBYxfRiaZkIdPRIBolZ2O5+5duCiC4VDIg25CdFE52GrAtZgEdNyH9sNHH9uY4Lr0Pt3q/cMXVrSYvduWJYWl2r4RGsnGkMi+BprC8rFWeVSXAHrxuvnFw==',key_name='tempest-TestMinimumBasicScenario-20692004',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-1vfwhcwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:53:57Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=cfe56b3e-2553-4a80-990b-974d4a8d84a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG os_vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad991858-4f, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad991858-4f, col_values=(('external_ids', {'iface-id': 'ad991858-4f5a-4176-99b9-fcc0c75c91b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:de:4f', 'vm-uuid': 'cfe56b3e-2553-4a80-990b-974d4a8d84a1'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:54:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:01 user nova-compute[73450]: INFO os_vif [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f')
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204842.089476, 9c32b066-e018-4db3-8b62-22aa7a3838c2 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] VM Resumed (Lifecycle Event)
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Instance spawned successfully.
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204842.0940497, 9c32b066-e018-4db3-8b62-22aa7a3838c2 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] VM Started (Lifecycle Event)
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-4927670b-a5dc-4221-890b-3e63a4244228 req-9706d869-e791-448c-aa42-6cf5046771ab service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4927670b-a5dc-4221-890b-3e63a4244228 req-9706d869-e791-448c-aa42-6cf5046771ab service nova] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4927670b-a5dc-4221-890b-3e63a4244228 req-9706d869-e791-448c-aa42-6cf5046771ab service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4927670b-a5dc-4221-890b-3e63a4244228 req-9706d869-e791-448c-aa42-6cf5046771ab service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-4927670b-a5dc-4221-890b-3e63a4244228 req-9706d869-e791-448c-aa42-6cf5046771ab service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] No waiting events found dispatching network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:02 user nova-compute[73450]: WARNING nova.compute.manager [req-4927670b-a5dc-4221-890b-3e63a4244228 req-9706d869-e791-448c-aa42-6cf5046771ab service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received unexpected event network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 for instance with vm_state building and task_state spawning.
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:54:02 user nova-compute[73450]: INFO nova.compute.manager [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Took 25.03 seconds to build instance.
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5bf6c5e0-8547-4dff-9dfe-3f044f5ad1f5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.212s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-3cbd8ab8-5a8e-44ee-8d8e-378273350c65 req-32ce50bc-443b-4489-9ca6-244e8a9367b1 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3cbd8ab8-5a8e-44ee-8d8e-378273350c65 req-32ce50bc-443b-4489-9ca6-244e8a9367b1 service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3cbd8ab8-5a8e-44ee-8d8e-378273350c65 req-32ce50bc-443b-4489-9ca6-244e8a9367b1 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3cbd8ab8-5a8e-44ee-8d8e-378273350c65 req-32ce50bc-443b-4489-9ca6-244e8a9367b1 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-3cbd8ab8-5a8e-44ee-8d8e-378273350c65 req-32ce50bc-443b-4489-9ca6-244e8a9367b1 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:02 user nova-compute[73450]: WARNING nova.compute.manager [req-3cbd8ab8-5a8e-44ee-8d8e-378273350c65 req-32ce50bc-443b-4489-9ca6-244e8a9367b1 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 16:54:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for cfe56b3e-2553-4a80-990b-974d4a8d84a1 due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204844.7809083, cfe56b3e-2553-4a80-990b-974d4a8d84a1 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] VM Resumed (Lifecycle Event)
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:54:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance rebooted successfully.
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:54:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204844.781739, cfe56b3e-2553-4a80-990b-974d4a8d84a1 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] VM Started (Lifecycle Event)
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-13436d65-34be-4045-87d1-1f8b3642767d tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.867s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [req-03a58f53-c09f-40e4-b8bb-ffa475761c95 req-07bfcf61-4c81-4f5c-99ab-c729442fb12a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-03a58f53-c09f-40e4-b8bb-ffa475761c95 req-07bfcf61-4c81-4f5c-99ab-c729442fb12a service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-03a58f53-c09f-40e4-b8bb-ffa475761c95 req-07bfcf61-4c81-4f5c-99ab-c729442fb12a service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-03a58f53-c09f-40e4-b8bb-ffa475761c95 req-07bfcf61-4c81-4f5c-99ab-c729442fb12a service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:04 user nova-compute[73450]: DEBUG nova.compute.manager [req-03a58f53-c09f-40e4-b8bb-ffa475761c95 req-07bfcf61-4c81-4f5c-99ab-c729442fb12a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:04 user nova-compute[73450]: WARNING nova.compute.manager [req-03a58f53-c09f-40e4-b8bb-ffa475761c95 req-07bfcf61-4c81-4f5c-99ab-c729442fb12a service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state active and task_state None.
Aug 16 16:54:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing instance network info cache due to event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:54:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:54:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:54:10 user nova-compute[73450]: DEBUG nova.network.neutron [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:54:11 user nova-compute[73450]: DEBUG nova.network.neutron [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updated VIF entry in instance network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:54:11 user nova-compute[73450]: DEBUG nova.network.neutron [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:54:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bced83af-aab6-48a5-b5ef-368c752e8a4e req-9c7206dc-788f-4f28-97f4-5a56b625488e service nova] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:54:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:13 user nova-compute[73450]: DEBUG nova.objects.instance [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:13 user nova-compute[73450]: INFO nova.compute.manager [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attaching volume 5df39f44-b869-4ddf-b7ff-dc57175f1b67 to /dev/vdb
Aug 16 16:54:14 user nova-compute[73450]: DEBUG os_brick.utils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0d7a5-48ae-4b9f-9a24-1f2c1a119895]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f123a4-6cff-4524-92eb-208e87a1de5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42651f8-03b0-4033-af3f-8d2d796407a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa871f9-1b46-4311-8362-1b40acb05a77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:54:14 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:54:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[948881a1-8a70-47d3-b48a-3683ee113621]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG os_brick.utils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating existing volume attachment record: 366ad4f8-67dc-4ae0-ab42-7cd29224e16a {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:54:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:16 user nova-compute[73450]: INFO nova.compute.manager [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Shelving
Aug 16 16:54:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-7f0134df-575f-48e6-b6ac-42f75c1628fa req-aa623f4f-1128-45f3-b3c0-a9559b81e6c6 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-unplugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7f0134df-575f-48e6-b6ac-42f75c1628fa req-aa623f4f-1128-45f3-b3c0-a9559b81e6c6 service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7f0134df-575f-48e6-b6ac-42f75c1628fa req-aa623f4f-1128-45f3-b3c0-a9559b81e6c6 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7f0134df-575f-48e6-b6ac-42f75c1628fa req-aa623f4f-1128-45f3-b3c0-a9559b81e6c6 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-7f0134df-575f-48e6-b6ac-42f75c1628fa req-aa623f4f-1128-45f3-b3c0-a9559b81e6c6 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-unplugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:16 user nova-compute[73450]: WARNING nova.compute.manager [req-7f0134df-575f-48e6-b6ac-42f75c1628fa req-aa623f4f-1128-45f3-b3c0-a9559b81e6c6 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-unplugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state active and task_state shelving.
Aug 16 16:54:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance destroyed successfully.
Aug 16 16:54:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Beginning cold snapshot process
Aug 16 16:54:17 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:54:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk /opt/stack/data/nova/instances/snapshots/tmpssyehnpk/d482f66dc90949408e4ed81433973c29 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk /opt/stack/data/nova/instances/snapshots/tmpssyehnpk/d482f66dc90949408e4ed81433973c29" returned: 0 in 0.840s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Snapshot extracted, beginning image upload
Aug 16 16:54:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c1bc868-ea21-440a-be0a-0922ba6f4f79 req-c8e0f4f4-1415-403e-a34d-689268d9a694 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c1bc868-ea21-440a-be0a-0922ba6f4f79 req-c8e0f4f4-1415-403e-a34d-689268d9a694 service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c1bc868-ea21-440a-be0a-0922ba6f4f79 req-c8e0f4f4-1415-403e-a34d-689268d9a694 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c1bc868-ea21-440a-be0a-0922ba6f4f79 req-c8e0f4f4-1415-403e-a34d-689268d9a694 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c1bc868-ea21-440a-be0a-0922ba6f4f79 req-c8e0f4f4-1415-403e-a34d-689268d9a694 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:19 user nova-compute[73450]: WARNING nova.compute.manager [req-9c1bc868-ea21-440a-be0a-0922ba6f4f79 req-c8e0f4f4-1415-403e-a34d-689268d9a694 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 16:54:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Snapshot image upload complete
Aug 16 16:54:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:21 user nova-compute[73450]: INFO nova.compute.manager [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Shelve offloading
Aug 16 16:54:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance destroyed successfully.
Aug 16 16:54:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:54:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:54:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:54:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:54:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:54:22 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance destroyed successfully.
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.objects.instance [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'resources' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-82395713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-82395713',id=32,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9wx1HqZBFRRzpOrl0b+KPMCa/xZA+meAVheL62++nu24P3x9fkJQdajlP29b1w+b+PSuHYCqa6QjCNhlam1eZXSMj8WjwnDJoCUDhdDPHO/+0ObZwZTrBhHjiiaxc75Q==',key_name='tempest-keypair-2132504027',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-r4x0kwml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member',shelved_at='2023-08-16T16:54:21.130849',shelved_host='user',shelved_image_id='e82aef58-2436-40a4-aaed-9d677c6d8c22'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=032b05e3-0db8-4029-9764-9fcce2eb55a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG os_vif [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6619da50-86, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing instance network info cache due to event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:22 user nova-compute[73450]: INFO os_vif [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86')
Aug 16 16:54:22 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Deleting instance files /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7_del
Aug 16 16:54:22 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Deletion of /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7_del complete
Aug 16 16:54:22 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Deleted allocations for instance 032b05e3-0db8-4029-9764-9fcce2eb55a7
Aug 16 16:54:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.objects.instance [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'numa_topology' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updated VIF entry in instance network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6619da50-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-741cd482-b65a-40d7-b86e-a668a19a3981 req-ce37f04d-076e-40ab-9d2c-7f07f9be5411 service nova] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:54:22 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:54:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-790cb7fc-905e-4eb1-b0d2-6a88013cac54 tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.571s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:54:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquired lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:54:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:54:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'info_cache' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating instance_info_cache with network_info: [{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Releasing lock "refresh_cache-b1ab59d8-8633-4be5-9fa5-d74e7c34df66" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:54:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance destroyed successfully.
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'resources' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:52:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG os_vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a62f6e8-e0, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:25 user nova-compute[73450]: INFO os_vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0')
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start _get_guest_xml network_info=[{"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'numa_topology' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:25 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:54:25 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:52:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:54:25 user nova-compute[73450]:   <uuid>b1ab59d8-8633-4be5-9fa5-d74e7c34df66</uuid>
Aug 16 16:54:25 user nova-compute[73450]:   <name>instance-00000016</name>
Aug 16 16:54:25 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:54:25 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:54:25 user nova-compute[73450]:   <metadata>
Aug 16 16:54:25 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:54:25 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:54:25 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeTestJSON-server-1851611719</nova:name>
Aug 16 16:54:25 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:54:25</nova:creationTime>
Aug 16 16:54:25 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:54:25 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:54:25 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:54:25 user nova-compute[73450]:       <nova:owner>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:user uuid="ba47a29f14cc441e826c9af67f20c96a">tempest-AttachVolumeTestJSON-570659826-project-member</nova:user>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:project uuid="d1acac15e03f4d6188cb3517a7901da4">tempest-AttachVolumeTestJSON-570659826</nova:project>
Aug 16 16:54:25 user nova-compute[73450]:       </nova:owner>
Aug 16 16:54:25 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:54:25 user nova-compute[73450]:       <nova:ports>
Aug 16 16:54:25 user nova-compute[73450]:         <nova:port uuid="4a62f6e8-e050-4dae-90ee-7b0724310e90">
Aug 16 16:54:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 16:54:25 user nova-compute[73450]:         </nova:port>
Aug 16 16:54:25 user nova-compute[73450]:       </nova:ports>
Aug 16 16:54:25 user nova-compute[73450]:     </nova:instance>
Aug 16 16:54:25 user nova-compute[73450]:   </metadata>
Aug 16 16:54:25 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:54:25 user nova-compute[73450]:     <system>
Aug 16 16:54:25 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:54:25 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:54:25 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:54:25 user nova-compute[73450]:       <entry name="serial">b1ab59d8-8633-4be5-9fa5-d74e7c34df66</entry>
Aug 16 16:54:25 user nova-compute[73450]:       <entry name="uuid">b1ab59d8-8633-4be5-9fa5-d74e7c34df66</entry>
Aug 16 16:54:25 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:54:25 user nova-compute[73450]:     </system>
Aug 16 16:54:25 user nova-compute[73450]:   </sysinfo>
Aug 16 16:54:25 user nova-compute[73450]:   <os>
Aug 16 16:54:25 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:54:25 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:54:25 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:54:25 user nova-compute[73450]:   </os>
Aug 16 16:54:25 user nova-compute[73450]:   <features>
Aug 16 16:54:25 user nova-compute[73450]:     <acpi/>
Aug 16 16:54:25 user nova-compute[73450]:     <apic/>
Aug 16 16:54:25 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:54:25 user nova-compute[73450]:   </features>
Aug 16 16:54:25 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:54:25 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:54:25 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:54:25 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:54:25 user nova-compute[73450]:   </clock>
Aug 16 16:54:25 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:54:25 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:54:25 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:54:25 user nova-compute[73450]:   </cpu>
Aug 16 16:54:25 user nova-compute[73450]:   <devices>
Aug 16 16:54:25 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:54:25 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:54:25 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk"/>
Aug 16 16:54:25 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:54:25 user nova-compute[73450]:     </disk>
Aug 16 16:54:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:54:25 user nova-compute[73450]:       <mac address="fa:16:3e:64:3d:a7"/>
Aug 16 16:54:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:54:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:54:25 user nova-compute[73450]:       <target dev="tap4a62f6e8-e0"/>
Aug 16 16:54:25 user nova-compute[73450]:     </interface>
Aug 16 16:54:25 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:54:25 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/console.log" append="off"/>
Aug 16 16:54:25 user nova-compute[73450]:     </serial>
Aug 16 16:54:25 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:54:25 user nova-compute[73450]:     <video>
Aug 16 16:54:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:54:25 user nova-compute[73450]:     </video>
Aug 16 16:54:25 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:54:25 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:54:25 user nova-compute[73450]:     </rng>
Aug 16 16:54:25 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:54:25 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:54:25 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:54:25 user nova-compute[73450]:     </memballoon>
Aug 16 16:54:25 user nova-compute[73450]:   </devices>
Aug 16 16:54:25 user nova-compute[73450]: </domain>
Aug 16 16:54:25 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:54:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'migration_context' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:52:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG os_vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a62f6e8-e0, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a62f6e8-e0, col_values=(('external_ids', {'iface-id': '4a62f6e8-e050-4dae-90ee-7b0724310e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:3d:a7', 'vm-uuid': 'b1ab59d8-8633-4be5-9fa5-d74e7c34df66'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:54:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:26 user nova-compute[73450]: INFO os_vif [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0')
Aug 16 16:54:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFDGZiCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:54:27 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:54:27 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:54:27 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16bc0c-0e03-4b58-9fbd-3c535698adef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:54:27 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.108s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae2378-fbd8-4e6a-af14-808e6310cd2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67] added
Aug 16 16:54:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0e0a0c-ee27-4638-b250-67a8ca59538c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5ba363-a61b-4901-b154-11f2f778275e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFDGZiCq {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFDGZiCq" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706ed28-a64b-4a8a-b372-feac83c82ab6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFDGZiCq'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77056e-17c3-45d2-9f01-51349393b4d8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[564300b2-dfc2-4fe5-9e58-42563db9ac5c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3a1a6-3afd-4c1d-a020-acd0c1e30840]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260]
Aug 16 16:54:27 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260] successful.
Aug 16 16:54:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebb6a84-3357-4a54-acfd-a06b96d42651]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b77f02e-8774-4a50-a143-a58d2e49107a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 (non-flash)
Aug 16 16:54:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82f1171-c881-45c7-9e80-0806b06d5620]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFDGZiCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c6f08a0-c424-4525-940a-34af26d5b4d4 req-79881346-10a1-4c75-913b-d2c003dae482 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c6f08a0-c424-4525-940a-34af26d5b4d4 req-79881346-10a1-4c75-913b-d2c003dae482 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c6f08a0-c424-4525-940a-34af26d5b4d4 req-79881346-10a1-4c75-913b-d2c003dae482 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c6f08a0-c424-4525-940a-34af26d5b4d4 req-79881346-10a1-4c75-913b-d2c003dae482 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c6f08a0-c424-4525-940a-34af26d5b4d4 req-79881346-10a1-4c75-913b-d2c003dae482 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:27 user nova-compute[73450]: WARNING nova.compute.manager [req-9c6f08a0-c424-4525-940a-34af26d5b4d4 req-79881346-10a1-4c75-913b-d2c003dae482 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state powering-on.
Aug 16 16:54:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26363306566663237', 'path': '/dev/sdg'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363306566663237', 'path': '/dev/sdg'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG nova.objects.instance [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:54:28 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:54:28 user nova-compute[73450]:   <source dev="/dev/sdg"/>
Aug 16 16:54:28 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:54:28 user nova-compute[73450]:   <serial>5df39f44-b869-4ddf-b7ff-dc57175f1b67</serial>
Aug 16 16:54:28 user nova-compute[73450]: </disk>
Aug 16 16:54:28 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:54:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] No VIF found with MAC fa:16:3e:60:ff:4b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4de1a97c-7141-4bf0-9f03-f5dce583840b tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.130s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204869.775071, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Resumed (Lifecycle Event)
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:54:29 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance rebooted successfully.
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8bcc3135-904b-4592-ba4a-999217486273 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-e551ef4b-3c17-49ca-8b8b-eb63badbedec req-d49bdda2-6585-488f-8040-42c78069f113 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e551ef4b-3c17-49ca-8b8b-eb63badbedec req-d49bdda2-6585-488f-8040-42c78069f113 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e551ef4b-3c17-49ca-8b8b-eb63badbedec req-d49bdda2-6585-488f-8040-42c78069f113 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e551ef4b-3c17-49ca-8b8b-eb63badbedec req-d49bdda2-6585-488f-8040-42c78069f113 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-e551ef4b-3c17-49ca-8b8b-eb63badbedec req-d49bdda2-6585-488f-8040-42c78069f113 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:29 user nova-compute[73450]: WARNING nova.compute.manager [req-e551ef4b-3c17-49ca-8b8b-eb63badbedec req-d49bdda2-6585-488f-8040-42c78069f113 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state stopped and task_state powering-on.
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:54:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204869.7767334, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Started (Lifecycle Event)
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:54:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:32 user nova-compute[73450]: INFO nova.compute.manager [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Detaching volume 5df39f44-b869-4ddf-b7ff-dc57175f1b67
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204857.2220526, 032b05e3-0db8-4029-9764-9fcce2eb55a7 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:54:32 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] VM Stopped (Lifecycle Event)
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2d61fb93-a4d2-47ea-ad88-02f60ced9107 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:54:32 user nova-compute[73450]: INFO nova.virt.block_device [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Attempting to driver detach volume 5df39f44-b869-4ddf-b7ff-dc57175f1b67 from mountpoint /dev/vdb
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Attempting to detach device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:54:32 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:54:32 user nova-compute[73450]:   <source dev="/dev/sdg"/>
Aug 16 16:54:32 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:54:32 user nova-compute[73450]:   <serial>5df39f44-b869-4ddf-b7ff-dc57175f1b67</serial>
Aug 16 16:54:32 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:54:32 user nova-compute[73450]: </disk>
Aug 16 16:54:32 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:54:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the persistent domain config.
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:54:32 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:54:32 user nova-compute[73450]:   <source dev="/dev/sdg"/>
Aug 16 16:54:32 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:54:32 user nova-compute[73450]:   <serial>5df39f44-b869-4ddf-b7ff-dc57175f1b67</serial>
Aug 16 16:54:32 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:54:32 user nova-compute[73450]: </disk>
Aug 16 16:54:32 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204872.6970046, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:54:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully detached device vdb from instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 from the live domain config.
Aug 16 16:54:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFDGZiCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:54:32 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f6538-6317-438c-ad1b-2b76d1b51451]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4f9f09-7d0e-4c5f-8eb5-40a69ef05624]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 (non-flash)
Aug 16 16:54:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:54:32 user nova-compute[73450]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 (non-flash)
Aug 16 16:54:32 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2701301f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67'): ({'sdg'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Removing single pathed devices sdg {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb73c45-350b-4c70-a439-cd24f68632a0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c5241f-1424-44ec-8bed-d6a96de16ddf]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Flushing IO for device /dev/sdg {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d78929-9656-48af-bb73-f77112754a30]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84eb683-662e-45a3-8829-b180b0fecbfe]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] SCSI volumes sdg have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172cf2b-841c-4fe3-be17-ae41a936cb4b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e75aa7-c21f-4485-912b-1851d3a91d3b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260]
Aug 16 16:54:33 user nova-compute[73450]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67, portal: 172.16.0.220,3260] successful.
Aug 16 16:54:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df39f44-b869-4ddf-b7ff-dc57175f1b67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d8ffe-c2f6-41d3-838d-b16fc99d464b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] <== disconnect_volume: return (337ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'flavor' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6b2c7f82-4a41-4287-9374-21c1506978c4 tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:54:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [{"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-d1731c4d-0c63-4394-b50e-2db9c23a6951" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:54:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:54:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:51 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:54:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:57 user nova-compute[73450]: INFO nova.compute.manager [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Unrescuing
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:54:57 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'flavor' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-0ab7e14c-30c1-43b0-942a-0494ce4f0cfe req-554518ea-1c26-4261-ad47-d25f57d225c0 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ab7e14c-30c1-43b0-942a-0494ce4f0cfe req-554518ea-1c26-4261-ad47-d25f57d225c0 service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ab7e14c-30c1-43b0-942a-0494ce4f0cfe req-554518ea-1c26-4261-ad47-d25f57d225c0 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ab7e14c-30c1-43b0-942a-0494ce4f0cfe req-554518ea-1c26-4261-ad47-d25f57d225c0 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-0ab7e14c-30c1-43b0-942a-0494ce4f0cfe req-554518ea-1c26-4261-ad47-d25f57d225c0 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:54:58 user nova-compute[73450]: WARNING nova.compute.manager [req-0ab7e14c-30c1-43b0-942a-0494ce4f0cfe req-554518ea-1c26-4261-ad47-d25f57d225c0 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:54:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:54:58 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance destroyed successfully.
Aug 16 16:54:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:54:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for a36f0a56-ed4a-4593-8c78-f71a53938fec due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204902.387213, a36f0a56-ed4a-4593-8c78-f71a53938fec => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Resumed (Lifecycle Event)
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cf5c0068-e53b-4cad-a721-8781486f3c89 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:02 user nova-compute[73450]: WARNING nova.compute.manager [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:02 user nova-compute[73450]: WARNING nova.compute.manager [req-06f2e381-6967-48ed-887b-e10a05b23ac9 req-b2bcd0e4-8529-4119-a72f-07940fb5040a service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-922adee1-14e6-47d1-bf1e-d3e14b14e454 req-fd76d703-ab23-45aa-b175-8742166504bd service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-922adee1-14e6-47d1-bf1e-d3e14b14e454 req-fd76d703-ab23-45aa-b175-8742166504bd service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-922adee1-14e6-47d1-bf1e-d3e14b14e454 req-fd76d703-ab23-45aa-b175-8742166504bd service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-922adee1-14e6-47d1-bf1e-d3e14b14e454 req-fd76d703-ab23-45aa-b175-8742166504bd service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-922adee1-14e6-47d1-bf1e-d3e14b14e454 req-fd76d703-ab23-45aa-b175-8742166504bd service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:02 user nova-compute[73450]: WARNING nova.compute.manager [req-922adee1-14e6-47d1-bf1e-d3e14b14e454 req-fd76d703-ab23-45aa-b175-8742166504bd service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:02 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:55:02 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=6836MB free_disk=23.662120819091797GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:55:02 user nova-compute[73450]: INFO nova.compute.manager [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Unrescuing
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquired lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 16:55:02 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204902.3873541, a36f0a56-ed4a-4593-8c78-f71a53938fec => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:02 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Started (Lifecycle Event)
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a36f0a56-ed4a-4593-8c78-f71a53938fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5104e1fc-bcbb-4643-9d66-6f0db4339428 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9a63d50d-5b5b-401e-b6fc-960008baca37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance f0740cc8-0435-43d3-8e8d-c0b05240947e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9c32b066-e018-4db3-8b62-22aa7a3838c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updating instance_info_cache with network_info: [{"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Releasing lock "refresh_cache-5104e1fc-bcbb-4643-9d66-6f0db4339428" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'flavor' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.904s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.707s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-dd712df0-87f0-48f6-bff3-2e886b49f1a1 req-fa430d2e-d663-4045-b280-49fa6435ba64 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dd712df0-87f0-48f6-bff3-2e886b49f1a1 req-fa430d2e-d663-4045-b280-49fa6435ba64 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dd712df0-87f0-48f6-bff3-2e886b49f1a1 req-fa430d2e-d663-4045-b280-49fa6435ba64 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dd712df0-87f0-48f6-bff3-2e886b49f1a1 req-fa430d2e-d663-4045-b280-49fa6435ba64 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-dd712df0-87f0-48f6-bff3-2e886b49f1a1 req-fa430d2e-d663-4045-b280-49fa6435ba64 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:03 user nova-compute[73450]: WARNING nova.compute.manager [req-dd712df0-87f0-48f6-bff3-2e886b49f1a1 req-fa430d2e-d663-4045-b280-49fa6435ba64 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:55:03 user nova-compute[73450]: INFO nova.compute.claims [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Claim successful on node user
Aug 16 16:55:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance destroyed successfully.
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:55:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.policy [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb44f7411ad47b18d2c58a1dc6ac074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db72f2fe40fe410098164a19683782d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:55:04 user nova-compute[73450]: INFO nova.virt.block_device [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Booting with volume 79994e09-5f3c-465f-a16c-0c798b6b01b2 at /dev/vda
Aug 16 16:55:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG os_brick.utils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba3145-fa8a-49de-ba44-61f7b1b1b401]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[636e373d-4508-41c8-9c86-c744f06df1cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1c995c-90fe-4c08-8c39-c72fbe53b2c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17b042e-3642-49ba-b51e-41668a9332b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:55:04 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:55:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf1bcd6-2b56-4617-b1f3-c9a71f9ab901]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG os_brick.utils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:04 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating existing volume attachment record: 2e44985b-9559-42aa-bac1-75bdce718ce4 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Successfully created port: c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-67d0a625-7da2-4259-96ea-d4929ab5193a req-f65833f3-bcae-44d6-b5e5-8fb70e67d6e8 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-67d0a625-7da2-4259-96ea-d4929ab5193a req-f65833f3-bcae-44d6-b5e5-8fb70e67d6e8 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-67d0a625-7da2-4259-96ea-d4929ab5193a req-f65833f3-bcae-44d6-b5e5-8fb70e67d6e8 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-67d0a625-7da2-4259-96ea-d4929ab5193a req-f65833f3-bcae-44d6-b5e5-8fb70e67d6e8 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-67d0a625-7da2-4259-96ea-d4929ab5193a req-f65833f3-bcae-44d6-b5e5-8fb70e67d6e8 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:05 user nova-compute[73450]: WARNING nova.compute.manager [req-67d0a625-7da2-4259-96ea-d4929ab5193a req-f65833f3-bcae-44d6-b5e5-8fb70e67d6e8 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Successfully updated port: c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-changed-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Refreshing instance network info cache due to event network-changed-c5752bbb-fe02-446e-a096-3d0388da13be. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance network_info: |[{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Refreshing network info cache for port c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updated VIF entry in instance network info cache for port c5752bbb-fe02-446e-a096-3d0388da13be. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa472a2b-7c55-4a0b-a58f-33083fd070c4 req-9d1675b9-0423-4a15-b3a7-c5bdf4d9317c service nova] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:07 user nova-compute[73450]: WARNING nova.compute.manager [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:07 user nova-compute[73450]: WARNING nova.compute.manager [req-e5beb816-598e-4e56-b12b-e64615f9b254 req-dffaec23-5082-4784-a47e-bcb78f321166 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state rescued and task_state unrescuing.
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 5104e1fc-bcbb-4643-9d66-6f0db4339428 due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204908.1452239, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:08 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Resumed (Lifecycle Event)
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-46ef643e-653c-4573-a330-2300ca9ca307 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:08 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204908.1465392, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:08 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Started (Lifecycle Event)
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:55:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Creating image(s)
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Ensure instance console log exists: /opt/stack/data/nova/instances/5df06efe-b1d6-470e-a230-bf63734642f5/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Start _get_guest_xml network_info=[{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '2e44985b-9559-42aa-bac1-75bdce718ce4', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5df06efe-b1d6-470e-a230-bf63734642f5', 'attached_at': '', 'detached_at': '', 'volume_id': '79994e09-5f3c-465f-a16c-0c798b6b01b2', 'serial': '79994e09-5f3c-465f-a16c-0c798b6b01b2'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:55:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:55:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:17 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:55:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383a0e7-82ec-4a02-881d-b728265fd2f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:55:17 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[176f7b52-ce63-4b2d-9dfd-ea35d4f53cb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2] added
Aug 16 16:55:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8094964-9892-4436-8e28-258a0a03b5ce]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[660c179f-75fe-422a-8f79-583e5b030946]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFpzDWPK {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFpzDWPK" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9aba54-aab6-4c80-8122-c0b74fc850a4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFpzDWPK'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b2875-4fdc-420a-8db4-fefae1e00a15]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1935156-64e1-4802-a1e1-d321845b449d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda29f25-c4b2-4039-adf2-c39d64b0ca26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]
Aug 16 16:55:18 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.
Aug 16 16:55:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac41f89-e343-45a7-a6d8-b6d16c5b2077]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8719f7c5-2951-4934-8182-b558eb230081]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea10e0-76dd-4361-a4f3-f7a87c1e6fee]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23364663063383966', 'path': '/dev/sdg'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364663063383966', 'path': '/dev/sdg'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1646450735',display_name='tempest-ServerActionsTestOtherA-server-1646450735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1646450735',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-60302x42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:55:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=5df06efe-b1d6-470e-a230-bf63734642f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_devices' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:55:19 user nova-compute[73450]:   <uuid>5df06efe-b1d6-470e-a230-bf63734642f5</uuid>
Aug 16 16:55:19 user nova-compute[73450]:   <name>instance-00000023</name>
Aug 16 16:55:19 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:55:19 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:55:19 user nova-compute[73450]:   <metadata>
Aug 16 16:55:19 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:55:19 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:55:19 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherA-server-1646450735</nova:name>
Aug 16 16:55:19 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:55:17</nova:creationTime>
Aug 16 16:55:19 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:55:19 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:55:19 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:55:19 user nova-compute[73450]:       <nova:owner>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:user uuid="cfb44f7411ad47b18d2c58a1dc6ac074">tempest-ServerActionsTestOtherA-1309270761-project-member</nova:user>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:project uuid="db72f2fe40fe410098164a19683782d4">tempest-ServerActionsTestOtherA-1309270761</nova:project>
Aug 16 16:55:19 user nova-compute[73450]:       </nova:owner>
Aug 16 16:55:19 user nova-compute[73450]:       <nova:ports>
Aug 16 16:55:19 user nova-compute[73450]:         <nova:port uuid="c5752bbb-fe02-446e-a096-3d0388da13be">
Aug 16 16:55:19 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 16:55:19 user nova-compute[73450]:         </nova:port>
Aug 16 16:55:19 user nova-compute[73450]:       </nova:ports>
Aug 16 16:55:19 user nova-compute[73450]:     </nova:instance>
Aug 16 16:55:19 user nova-compute[73450]:   </metadata>
Aug 16 16:55:19 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:55:19 user nova-compute[73450]:     <system>
Aug 16 16:55:19 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:55:19 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:55:19 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:55:19 user nova-compute[73450]:       <entry name="serial">5df06efe-b1d6-470e-a230-bf63734642f5</entry>
Aug 16 16:55:19 user nova-compute[73450]:       <entry name="uuid">5df06efe-b1d6-470e-a230-bf63734642f5</entry>
Aug 16 16:55:19 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:55:19 user nova-compute[73450]:     </system>
Aug 16 16:55:19 user nova-compute[73450]:   </sysinfo>
Aug 16 16:55:19 user nova-compute[73450]:   <os>
Aug 16 16:55:19 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:55:19 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:55:19 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:55:19 user nova-compute[73450]:   </os>
Aug 16 16:55:19 user nova-compute[73450]:   <features>
Aug 16 16:55:19 user nova-compute[73450]:     <acpi/>
Aug 16 16:55:19 user nova-compute[73450]:     <apic/>
Aug 16 16:55:19 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:55:19 user nova-compute[73450]:   </features>
Aug 16 16:55:19 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:55:19 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:55:19 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:55:19 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:55:19 user nova-compute[73450]:   </clock>
Aug 16 16:55:19 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:55:19 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:55:19 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:55:19 user nova-compute[73450]:   </cpu>
Aug 16 16:55:19 user nova-compute[73450]:   <devices>
Aug 16 16:55:19 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:55:19 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:55:19 user nova-compute[73450]:       <source dev="/dev/sdg"/>
Aug 16 16:55:19 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:55:19 user nova-compute[73450]:       <serial>79994e09-5f3c-465f-a16c-0c798b6b01b2</serial>
Aug 16 16:55:19 user nova-compute[73450]:     </disk>
Aug 16 16:55:19 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:55:19 user nova-compute[73450]:       <mac address="fa:16:3e:52:80:be"/>
Aug 16 16:55:19 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:55:19 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:55:19 user nova-compute[73450]:       <target dev="tapc5752bbb-fe"/>
Aug 16 16:55:19 user nova-compute[73450]:     </interface>
Aug 16 16:55:19 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:55:19 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/5df06efe-b1d6-470e-a230-bf63734642f5/console.log" append="off"/>
Aug 16 16:55:19 user nova-compute[73450]:     </serial>
Aug 16 16:55:19 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:55:19 user nova-compute[73450]:     <video>
Aug 16 16:55:19 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:55:19 user nova-compute[73450]:     </video>
Aug 16 16:55:19 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:55:19 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:55:19 user nova-compute[73450]:     </rng>
Aug 16 16:55:19 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:55:19 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:55:19 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:55:19 user nova-compute[73450]:     </memballoon>
Aug 16 16:55:19 user nova-compute[73450]:   </devices>
Aug 16 16:55:19 user nova-compute[73450]: </domain>
Aug 16 16:55:19 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1646450735',display_name='tempest-ServerActionsTestOtherA-server-1646450735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1646450735',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-60302x42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:55:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=5df06efe-b1d6-470e-a230-bf63734642f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG os_vif [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5752bbb-fe, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5752bbb-fe, col_values=(('external_ids', {'iface-id': 'c5752bbb-fe02-446e-a096-3d0388da13be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:80:be', 'vm-uuid': '5df06efe-b1d6-470e-a230-bf63734642f5'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:19 user nova-compute[73450]: INFO os_vif [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe')
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No VIF found with MAC fa:16:3e:52:80:be, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:55:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-7d0c06a8-9b2a-4ff5-a990-40a60b39e6b1 req-7c4c8008-fe79-44fa-8f2e-c91dec212f7c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7d0c06a8-9b2a-4ff5-a990-40a60b39e6b1 req-7c4c8008-fe79-44fa-8f2e-c91dec212f7c service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7d0c06a8-9b2a-4ff5-a990-40a60b39e6b1 req-7c4c8008-fe79-44fa-8f2e-c91dec212f7c service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7d0c06a8-9b2a-4ff5-a990-40a60b39e6b1 req-7c4c8008-fe79-44fa-8f2e-c91dec212f7c service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-7d0c06a8-9b2a-4ff5-a990-40a60b39e6b1 req-7c4c8008-fe79-44fa-8f2e-c91dec212f7c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:20 user nova-compute[73450]: WARNING nova.compute.manager [req-7d0c06a8-9b2a-4ff5-a990-40a60b39e6b1 req-7c4c8008-fe79-44fa-8f2e-c91dec212f7c service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state building and task_state spawning.
Aug 16 16:55:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204922.8095448, 5df06efe-b1d6-470e-a230-bf63734642f5 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:22 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] VM Resumed (Lifecycle Event)
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:55:22 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance spawned successfully.
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:22 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204922.8123233, 5df06efe-b1d6-470e-a230-bf63734642f5 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:22 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] VM Started (Lifecycle Event)
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-249f18dd-95d5-4197-896a-aa2226b8ee9d req-e653923a-1133-487d-8ee1-059b1e15ae24 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-249f18dd-95d5-4197-896a-aa2226b8ee9d req-e653923a-1133-487d-8ee1-059b1e15ae24 service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-249f18dd-95d5-4197-896a-aa2226b8ee9d req-e653923a-1133-487d-8ee1-059b1e15ae24 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-249f18dd-95d5-4197-896a-aa2226b8ee9d req-e653923a-1133-487d-8ee1-059b1e15ae24 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-249f18dd-95d5-4197-896a-aa2226b8ee9d req-e653923a-1133-487d-8ee1-059b1e15ae24 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:22 user nova-compute[73450]: WARNING nova.compute.manager [req-249f18dd-95d5-4197-896a-aa2226b8ee9d req-e653923a-1133-487d-8ee1-059b1e15ae24 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state building and task_state spawning.
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:22 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:55:22 user nova-compute[73450]: INFO nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 16 16:55:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:23 user nova-compute[73450]: INFO nova.compute.manager [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Took 20.00 seconds to build instance.
Aug 16 16:55:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cdd1b5f5-a32e-492a-b16f-796df62aa1c6 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.116s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-changed-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Refreshing instance network info cache due to event network-changed-15a4b383-d9ed-4548-a49d-a509a177e33c. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:55:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] Acquiring lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] Acquired lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Refreshing network info cache for port 15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updated VIF entry in instance network info cache for port 15a4b383-d9ed-4548-a49d-a509a177e33c. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updating instance_info_cache with network_info: [{"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'flavor' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e6b55a3e-991c-4e5f-ad22-05654400207f req-f797927d-ec1b-4da4-bb0e-9ee7149b0e6d service nova] Releasing lock "refresh_cache-f0740cc8-0435-43d3-8e8d-c0b05240947e" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:27 user nova-compute[73450]: INFO nova.compute.manager [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attaching volume 32dfbb40-5fd0-4f98-b60d-958fc1963ec5 to /dev/vdb
Aug 16 16:55:27 user nova-compute[73450]: DEBUG os_brick.utils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a262a-f31f-41da-a15d-fac849371ddc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2c59a-2aa2-48bf-9103-5be3dd90834e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[033eae5b-d3f8-4d9a-93ba-3482fe10ad5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd9c9b-c27a-43d5-8f04-f37a70c75c50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:55:27 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:55:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb680be-f27e-419e-9b8c-c7fef5655f44]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG os_brick.utils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:27 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updating existing volume attachment record: c99d1ab9-9f35-44fe-ab21-f89a90a835e9 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:55:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-changed-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Refreshing instance network info cache due to event network-changed-a3323a8e-6558-4091-861e-d4e943ca0bd2. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:55:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] Acquiring lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] Acquired lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:28 user nova-compute[73450]: DEBUG nova.network.neutron [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Refreshing network info cache for port a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:29 user nova-compute[73450]: INFO nova.compute.manager [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Terminating instance
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updated VIF entry in instance network info cache for port a3323a8e-6558-4091-861e-d4e943ca0bd2. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updating instance_info_cache with network_info: [{"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e819273-15c7-4af1-a9f6-20e0ab606959 req-82a5fafc-a3e1-42ae-8bfd-46c34f96e4b4 service nova] Releasing lock "refresh_cache-9c32b066-e018-4db3-8b62-22aa7a3838c2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c3d6801-c640-40c9-9d06-5f806b8b5e93 req-810cfa83-e791-46bb-8fcb-4173d5703a22 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-vif-unplugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c3d6801-c640-40c9-9d06-5f806b8b5e93 req-810cfa83-e791-46bb-8fcb-4173d5703a22 service nova] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c3d6801-c640-40c9-9d06-5f806b8b5e93 req-810cfa83-e791-46bb-8fcb-4173d5703a22 service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2c3d6801-c640-40c9-9d06-5f806b8b5e93 req-810cfa83-e791-46bb-8fcb-4173d5703a22 service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c3d6801-c640-40c9-9d06-5f806b8b5e93 req-810cfa83-e791-46bb-8fcb-4173d5703a22 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] No waiting events found dispatching network-vif-unplugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-2c3d6801-c640-40c9-9d06-5f806b8b5e93 req-810cfa83-e791-46bb-8fcb-4173d5703a22 service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-vif-unplugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Instance destroyed successfully.
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'resources' on Instance uuid 9c32b066-e018-4db3-8b62-22aa7a3838c2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1293876104',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1293876104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1293876104',id=34,image_ref='1feff467-a080-43ad-a1eb-9dbe35f35f93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtoOqlt5hzwf1j6qDwk6r/4dBk/1L9znI0nhApRrPmPbjrIi1cPxYHMPjqNVASjNWTdRoKcasiiPzSEGTTNA1IjZofjnMKJNWBAaDmoTnDE1jw9UIElL4Q/T0Yzs+Dh0A==',key_name='tempest-keypair-1874210094',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-q40e3a86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-717711848',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=9c32b066-e018-4db3-8b62-22aa7a3838c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "address": "fa:16:3e:38:b9:fe", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3323a8e-65", "ovs_interfaceid": "a3323a8e-6558-4091-861e-d4e943ca0bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_vif [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3323a8e-65, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:55:29 user nova-compute[73450]: INFO os_vif [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3323a8e-6558-4091-861e-d4e943ca0bd2,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3323a8e-65')
Aug 16 16:55:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuQHTRqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:29 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90a9b2-4815-4890-8579-7696bd482e76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6446a8db-28cb-4c25-93e1-a1dde8bc5216]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:29 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:29 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:29 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270196950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165'): ({'sdf'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Removing single pathed devices sdf {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:55:29 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb44973-17c4-407b-ab31-b9d89f5a3c80]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a09aed5-cd8e-429b-9738-917475c20d6f]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flushing IO for device /dev/sdf {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a017363-fee2-43d6-b978-5d63722f5222]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc596040-c3cb-4c8e-a5e6-41cc3e4443bb]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cbe96f-8beb-43d0-a89a-de52b14224a7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e5816-2e26-4f15-b438-dfd3579a6fe3]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260]
Aug 16 16:55:30 user nova-compute[73450]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165, portal: 172.16.0.220,3260] successful.
Aug 16 16:55:30 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[34702e87-822b-44c1-bea5-e92e0a8beb70]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== disconnect_volume: return (339ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:55:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Deleting instance files /opt/stack/data/nova/instances/9c32b066-e018-4db3-8b62-22aa7a3838c2_del
Aug 16 16:55:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Deletion of /opt/stack/data/nova/instances/9c32b066-e018-4db3-8b62-22aa7a3838c2_del complete
Aug 16 16:55:30 user nova-compute[73450]: INFO nova.compute.manager [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 16 16:55:30 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:55:30 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:31 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Took 1.03 seconds to deallocate network for instance.
Aug 16 16:55:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-786158cf-74a1-46e1-956c-b76548e4813c req-a7e63542-27de-4188-aa08-4f4e0a3e7d1c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-vif-deleted-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:31 user nova-compute[73450]: INFO nova.compute.manager [req-786158cf-74a1-46e1-956c-b76548e4813c req-a7e63542-27de-4188-aa08-4f4e0a3e7d1c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Neutron deleted interface a3323a8e-6558-4091-861e-d4e943ca0bd2; detaching it from the instance and deleting it from the info cache
Aug 16 16:55:31 user nova-compute[73450]: DEBUG nova.network.neutron [req-786158cf-74a1-46e1-956c-b76548e4813c req-a7e63542-27de-4188-aa08-4f4e0a3e7d1c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-786158cf-74a1-46e1-956c-b76548e4813c req-a7e63542-27de-4188-aa08-4f4e0a3e7d1c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Detach interface failed, port_id=a3323a8e-6558-4091-861e-d4e943ca0bd2, reason: Instance 9c32b066-e018-4db3-8b62-22aa7a3838c2 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-123a9787-8e5d-4ece-acdb-861c4d44c8b5 req-90f33be7-50fa-4f6f-9b8e-9e8bf584e65c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received event network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-123a9787-8e5d-4ece-acdb-861c4d44c8b5 req-90f33be7-50fa-4f6f-9b8e-9e8bf584e65c service nova] Acquiring lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-123a9787-8e5d-4ece-acdb-861c4d44c8b5 req-90f33be7-50fa-4f6f-9b8e-9e8bf584e65c service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-123a9787-8e5d-4ece-acdb-861c4d44c8b5 req-90f33be7-50fa-4f6f-9b8e-9e8bf584e65c service nova] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-123a9787-8e5d-4ece-acdb-861c4d44c8b5 req-90f33be7-50fa-4f6f-9b8e-9e8bf584e65c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] No waiting events found dispatching network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:31 user nova-compute[73450]: WARNING nova.compute.manager [req-123a9787-8e5d-4ece-acdb-861c4d44c8b5 req-90f33be7-50fa-4f6f-9b8e-9e8bf584e65c service nova] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Received unexpected event network-vif-plugged-a3323a8e-6558-4091-861e-d4e943ca0bd2 for instance with vm_state active and task_state deleting.
Aug 16 16:55:32 user nova-compute[73450]: INFO nova.compute.manager [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Took 1.06 seconds to detach 1 volumes for instance.
Aug 16 16:55:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Deleting volume: 0fd8bc66-74c7-44d7-8a2f-edcde9f8c165 {{(pid=73450) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 16:55:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:33 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:55:33 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:55:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:33 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Deleted allocations for instance 9c32b066-e018-4db3-8b62-22aa7a3838c2
Aug 16 16:55:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2db88851-61dd-4fa2-9412-2f22d2dc4ff6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9c32b066-e018-4db3-8b62-22aa7a3838c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.246s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHwEJlcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:40 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:40 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:40 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec9bdf8-f31a-4e86-8a46-a68a0d88c23c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:55:40 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeff1ed2-5f02-4e30-ad94-cb8e4168ad98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5] added
Aug 16 16:55:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d86c1-154a-48e8-bbb2-5bd1c08cd89a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85c988c-3720-4558-88d0-40aa71369d67]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHwEJlcm {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHwEJlcm" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e6aef5-2111-4685-833f-ef67fdaf51c0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHwEJlcm'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad45b3-78d9-4d97-a092-88b7ff311df1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04c5b0e-0618-4054-ac43-780e638240bf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:40 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a683b13c-6558-49f4-9a2b-0e71eaef0345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260]
Aug 16 16:55:40 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260] successful.
Aug 16 16:55:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec51a976-2376-453a-a69c-eaee3bd344dd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[761570cc-ed6a-4c95-8f94-1a232f1a54f4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:41 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff62937-a58b-4a24-b8f2-41b32eda43cc]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHwEJlcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:55:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26664323461383134', 'path': '/dev/sdf'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664323461383134', 'path': '/dev/sdf'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'flavor' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:55:42 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:55:42 user nova-compute[73450]:   <source dev="/dev/sdf"/>
Aug 16 16:55:42 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:55:42 user nova-compute[73450]:   <serial>32dfbb40-5fd0-4f98-b60d-958fc1963ec5</serial>
Aug 16 16:55:42 user nova-compute[73450]: </disk>
Aug 16 16:55:42 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No VIF found with MAC fa:16:3e:1e:e1:66, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:55:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a35ce221-5b59-45b2-aaa8-2d2826413e8b tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.263s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:44 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204929.8434262, 9c32b066-e018-4db3-8b62-22aa7a3838c2 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:44 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] VM Stopped (Lifecycle Event)
Aug 16 16:55:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be102684-cde4-4310-b535-87475e005502 None None] [instance: 9c32b066-e018-4db3-8b62-22aa7a3838c2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG nova.objects.instance [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'flavor' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:46 user nova-compute[73450]: INFO nova.compute.manager [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attaching volume 5d7a0f96-a16b-4ab9-9a6a-05a71369a62f to /dev/vdc
Aug 16 16:55:46 user nova-compute[73450]: DEBUG os_brick.utils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4ec18-43ab-4fb7-9226-2047a545d260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da128503-73cb-46e7-b47c-903035296ae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f7dd0-9377-4318-a683-e51326abe1ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b581da-6968-4410-914f-9239a702817a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:55:46 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:55:46 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c733f-0546-430e-a3c6-d5a153e9dd13]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG os_brick.utils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:46 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updating existing volume attachment record: 44c856a2-3e8a-4515-8757-21d8aafd0945 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing instance network info cache due to event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updated VIF entry in instance network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-faf7c574-70d2-495d-8aa5-560820a73687 req-9f858c5b-cc95-4d90-9a6b-8de4d1949af7 service nova] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:50 user nova-compute[73450]: INFO nova.compute.manager [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Detaching volume 9ddb0f9c-cfe2-452a-8147-969df0c68d45
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:55:50 user nova-compute[73450]: INFO nova.virt.block_device [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Attempting to driver detach volume 9ddb0f9c-cfe2-452a-8147-969df0c68d45 from mountpoint /dev/vdb
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Attempting to detach device vdb from instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:55:50 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:55:50 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:55:50 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:55:50 user nova-compute[73450]:   <serial>9ddb0f9c-cfe2-452a-8147-969df0c68d45</serial>
Aug 16 16:55:50 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:55:50 user nova-compute[73450]: </disk>
Aug 16 16:55:50 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:55:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully detached device vdb from instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 from the persistent domain config.
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:55:50 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:55:50 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:55:50 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:55:50 user nova-compute[73450]:   <serial>9ddb0f9c-cfe2-452a-8147-969df0c68d45</serial>
Aug 16 16:55:50 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 16:55:50 user nova-compute[73450]: </disk>
Aug 16 16:55:50 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing instance network info cache due to event network-changed-ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] Acquiring lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] Acquired lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Refreshing network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204950.5841572, cfe56b3e-2553-4a80-990b-974d4a8d84a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:55:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully detached device vdb from instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 from the live domain config.
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyHxmMGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:50 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbbb3d7-8697-4af0-a0ad-2dc8b9618d58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e1254-68f4-4d61-9b02-dcc1d1b22b01]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:50 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28015ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[685abed0-26c4-4df5-afbe-f4c3ad27f10e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b45bd2f-04cc-4102-b8ca-07cd41fe6a8b]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f894a-70ab-407d-87c1-4a57d3107653]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6256511b-9409-470e-b7da-7689e0ca592b]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4594aff-efb0-450a-9f1f-f19a2cb39758]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabf1af8-b911-4d01-88ae-f7070cdc7a14]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260]
Aug 16 16:55:50 user nova-compute[73450]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45, portal: 172.16.0.220,3260] successful.
Aug 16 16:55:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddb0f9c-cfe2-452a-8147-969df0c68d45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9929782a-0d3c-48ea-8ff0-6fedce027a8f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== disconnect_volume: return (333ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:55:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG nova.network.neutron [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updated VIF entry in instance network info cache for port ad991858-4f5a-4176-99b9-fcc0c75c91b4. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG nova.network.neutron [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [{"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-91d23891-bba9-403a-b57b-c87580da5d80 req-e103f8c4-38d4-4138-8eeb-2907771d08d4 service nova] Releasing lock "refresh_cache-cfe56b3e-2553-4a80-990b-974d4a8d84a1" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [{"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-78128529-664d-4e24-9a7b-a242e67a2ddf" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG nova.objects.instance [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'flavor' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-063169be-cd00-479b-ae4c-a8e490fc4684 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.807s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:55:52 user nova-compute[73450]: INFO nova.compute.claims [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Claim successful on node user
Aug 16 16:55:52 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.network.neutron [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:55:53 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.policy [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3204a7c592ff4585be593753006fd5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ace27d486848e4a6ae14949629da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:55:53 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Creating image(s)
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "/opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "/opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk 1073741824" returned: 0 in 0.049s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:53 user nova-compute[73450]: WARNING nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] While synchronizing instance power states, found 15 instances in the database and 14 instances on the hypervisor.
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 679cc7af-3bba-44b0-9d76-3f053f87dd80 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid eed98e2e-e225-483c-93bf-b8100e2bc5fe {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 9a63d50d-5b5b-401e-b6fc-960008baca37 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG nova.network.neutron [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Successfully created port: 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Cannot resize image /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.objects.instance [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'migration_context' on Instance uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Ensure instance console log exists: /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Successfully updated port: 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquired lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-changed-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Refreshing instance network info cache due to event network-changed-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] Acquiring lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:55:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating instance_info_cache with network_info: [{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Releasing lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Instance network_info: |[{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] Acquired lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Refreshing network info cache for port 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Start _get_guest_xml network_info=[{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:55:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:55:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255447583',display_name='tempest-TestStampPattern-server-1255447583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255447583',id=36,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYwZqnqg7dO+ytxFjz6XdBi4yIzNz/7UrcYmlm0Yp3fzTPnQGAJvVEeoFigebR3Ay8FkG/g2G8In8fH/us7360kHsj5Ihla9q+Tr8gMmAHGnvFblbO8Eikw5YPaOPmJg==',key_name='tempest-TestStampPattern-481591227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ace27d486848e4a6ae14949629da11',ramdisk_id='',reservation_id='r-kmdv3d8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1739750355',owner_user_name='tempest-TestStampPattern-1739750355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:55:53Z,user_data=None,user_id='3204a7c592ff4585be593753006fd5bb',uuid=b1da2b30-72cd-46f8-8620-d8c044e79c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converting VIF {"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'pci_devices' on Instance uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:55:55 user nova-compute[73450]:   <uuid>b1da2b30-72cd-46f8-8620-d8c044e79c96</uuid>
Aug 16 16:55:55 user nova-compute[73450]:   <name>instance-00000024</name>
Aug 16 16:55:55 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:55:55 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:55:55 user nova-compute[73450]:   <metadata>
Aug 16 16:55:55 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:55:55 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:55:55 user nova-compute[73450]:       <nova:name>tempest-TestStampPattern-server-1255447583</nova:name>
Aug 16 16:55:55 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:55:55</nova:creationTime>
Aug 16 16:55:55 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:55:55 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:55:55 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:55:55 user nova-compute[73450]:       <nova:owner>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:user uuid="3204a7c592ff4585be593753006fd5bb">tempest-TestStampPattern-1739750355-project-member</nova:user>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:project uuid="33ace27d486848e4a6ae14949629da11">tempest-TestStampPattern-1739750355</nova:project>
Aug 16 16:55:55 user nova-compute[73450]:       </nova:owner>
Aug 16 16:55:55 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:55:55 user nova-compute[73450]:       <nova:ports>
Aug 16 16:55:55 user nova-compute[73450]:         <nova:port uuid="492e08a1-1bdc-47ea-ad6f-b7e77e6641e8">
Aug 16 16:55:55 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 16:55:55 user nova-compute[73450]:         </nova:port>
Aug 16 16:55:55 user nova-compute[73450]:       </nova:ports>
Aug 16 16:55:55 user nova-compute[73450]:     </nova:instance>
Aug 16 16:55:55 user nova-compute[73450]:   </metadata>
Aug 16 16:55:55 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:55:55 user nova-compute[73450]:     <system>
Aug 16 16:55:55 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:55:55 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:55:55 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:55:55 user nova-compute[73450]:       <entry name="serial">b1da2b30-72cd-46f8-8620-d8c044e79c96</entry>
Aug 16 16:55:55 user nova-compute[73450]:       <entry name="uuid">b1da2b30-72cd-46f8-8620-d8c044e79c96</entry>
Aug 16 16:55:55 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:55:55 user nova-compute[73450]:     </system>
Aug 16 16:55:55 user nova-compute[73450]:   </sysinfo>
Aug 16 16:55:55 user nova-compute[73450]:   <os>
Aug 16 16:55:55 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:55:55 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:55:55 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:55:55 user nova-compute[73450]:   </os>
Aug 16 16:55:55 user nova-compute[73450]:   <features>
Aug 16 16:55:55 user nova-compute[73450]:     <acpi/>
Aug 16 16:55:55 user nova-compute[73450]:     <apic/>
Aug 16 16:55:55 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:55:55 user nova-compute[73450]:   </features>
Aug 16 16:55:55 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:55:55 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:55:55 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:55:55 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:55:55 user nova-compute[73450]:   </clock>
Aug 16 16:55:55 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:55:55 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:55:55 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:55:55 user nova-compute[73450]:   </cpu>
Aug 16 16:55:55 user nova-compute[73450]:   <devices>
Aug 16 16:55:55 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:55:55 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:55:55 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk"/>
Aug 16 16:55:55 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:55:55 user nova-compute[73450]:     </disk>
Aug 16 16:55:55 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:55:55 user nova-compute[73450]:       <mac address="fa:16:3e:57:a2:63"/>
Aug 16 16:55:55 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:55:55 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:55:55 user nova-compute[73450]:       <target dev="tap492e08a1-1b"/>
Aug 16 16:55:55 user nova-compute[73450]:     </interface>
Aug 16 16:55:55 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:55:55 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/console.log" append="off"/>
Aug 16 16:55:55 user nova-compute[73450]:     </serial>
Aug 16 16:55:55 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:55:55 user nova-compute[73450]:     <video>
Aug 16 16:55:55 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:55:55 user nova-compute[73450]:     </video>
Aug 16 16:55:55 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:55:55 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:55:55 user nova-compute[73450]:     </rng>
Aug 16 16:55:55 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:55:55 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:55:55 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:55:55 user nova-compute[73450]:     </memballoon>
Aug 16 16:55:55 user nova-compute[73450]:   </devices>
Aug 16 16:55:55 user nova-compute[73450]: </domain>
Aug 16 16:55:55 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255447583',display_name='tempest-TestStampPattern-server-1255447583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255447583',id=36,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYwZqnqg7dO+ytxFjz6XdBi4yIzNz/7UrcYmlm0Yp3fzTPnQGAJvVEeoFigebR3Ay8FkG/g2G8In8fH/us7360kHsj5Ihla9q+Tr8gMmAHGnvFblbO8Eikw5YPaOPmJg==',key_name='tempest-TestStampPattern-481591227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ace27d486848e4a6ae14949629da11',ramdisk_id='',reservation_id='r-kmdv3d8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1739750355',owner_user_name='tempest-TestStampPattern-1739750355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:55:53Z,user_data=None,user_id='3204a7c592ff4585be593753006fd5bb',uuid=b1da2b30-72cd-46f8-8620-d8c044e79c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converting VIF {"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG os_vif [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap492e08a1-1b, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap492e08a1-1b, col_values=(('external_ids', {'iface-id': '492e08a1-1bdc-47ea-ad6f-b7e77e6641e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:a2:63', 'vm-uuid': 'b1da2b30-72cd-46f8-8620-d8c044e79c96'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:55 user nova-compute[73450]: INFO os_vif [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b')
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No VIF found with MAC fa:16:3e:57:a2:63, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updated VIF entry in instance network info cache for port 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating instance_info_cache with network_info: [{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-725006e7-740e-4724-9738-d724d85ec2a7 req-86f5e899-ca48-42e9-826e-402d24fd88cd service nova] Releasing lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-566a5a01-10a2-4271-9003-e63346413835 req-f776d3b8-da67-4f9e-beb4-7aa27029ab99 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-566a5a01-10a2-4271-9003-e63346413835 req-f776d3b8-da67-4f9e-beb4-7aa27029ab99 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-566a5a01-10a2-4271-9003-e63346413835 req-f776d3b8-da67-4f9e-beb4-7aa27029ab99 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-566a5a01-10a2-4271-9003-e63346413835 req-f776d3b8-da67-4f9e-beb4-7aa27029ab99 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-566a5a01-10a2-4271-9003-e63346413835 req-f776d3b8-da67-4f9e-beb4-7aa27029ab99 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:56 user nova-compute[73450]: WARNING nova.compute.manager [req-566a5a01-10a2-4271-9003-e63346413835 req-f776d3b8-da67-4f9e-beb4-7aa27029ab99 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state building and task_state spawning.
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204958.8031313, b1da2b30-72cd-46f8-8620-d8c044e79c96 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] VM Resumed (Lifecycle Event)
Aug 16 16:55:58 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Instance spawned successfully.
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-d185950b-e785-4c99-94c5-6587e38a2a63 req-2d9683ea-8f34-4e39-9d60-551e0d163fc1 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d185950b-e785-4c99-94c5-6587e38a2a63 req-2d9683ea-8f34-4e39-9d60-551e0d163fc1 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d185950b-e785-4c99-94c5-6587e38a2a63 req-2d9683ea-8f34-4e39-9d60-551e0d163fc1 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d185950b-e785-4c99-94c5-6587e38a2a63 req-2d9683ea-8f34-4e39-9d60-551e0d163fc1 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-d185950b-e785-4c99-94c5-6587e38a2a63 req-2d9683ea-8f34-4e39-9d60-551e0d163fc1 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:55:58 user nova-compute[73450]: WARNING nova.compute.manager [req-d185950b-e785-4c99-94c5-6587e38a2a63 req-2d9683ea-8f34-4e39-9d60-551e0d163fc1 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state building and task_state spawning.
Aug 16 16:55:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204958.8046527, b1da2b30-72cd-46f8-8620-d8c044e79c96 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:55:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] VM Started (Lifecycle Event)
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:55:58 user nova-compute[73450]: INFO nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:55:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: INFO nova.compute.manager [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Took 6.68 seconds to build instance.
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-be89eeb2-7023-42fc-97c3-876da6aa7ac1 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.791s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.226s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:55:59 user nova-compute[73450]: INFO nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQTonaes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:55:59 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:59 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:55:59 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f67b5f3-6161-471f-8073-a0e60040b9f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:55:59 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d796dc46-465c-41f1-93a9-9bfd7341b764]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f] added
Aug 16 16:55:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7faca18-166c-4f7b-bde7-0c7a9b1cf621]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14947a-b5e8-4062-bdf2-62a39320d0a6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQTonaes {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQTonaes" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[927165a0-8b03-44fc-bb65-339420d48a60]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQTonaes'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.064s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a8871-7618-473b-b405-75d087b2f7d7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52fbef-fae2-421b-bca8-5e56ec37941b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2d9f24-87a6-41cd-bcb6-c403dfc2eb71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260]
Aug 16 16:55:59 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260] successful.
Aug 16 16:55:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd1597-855f-44fa-b337-2c47f79cc8c0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1470fa5-48ed-4a97-8fc5-a4c5963741f5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f (non-flash)
Aug 16 16:55:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:55:59 user nova-compute[73450]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f (non-flash)
Aug 16 16:55:59 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.481s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099703b-72f0-4ed7-be96-ce5938e5504f]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:55:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQTonaes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:56:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:56:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=6815MB free_disk=23.640995025634766GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.560s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] <== connect_volume: return (1563ms) {'type': 'block', 'scsi_wwn': '23034636461306261', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034636461306261', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'flavor' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:56:00 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:00 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:56:00 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:56:00 user nova-compute[73450]:   <serial>5d7a0f96-a16b-4ab9-9a6a-05a71369a62f</serial>
Aug 16 16:56:00 user nova-compute[73450]: </disk>
Aug 16 16:56:00 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a36f0a56-ed4a-4593-8c78-f71a53938fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5104e1fc-bcbb-4643-9d66-6f0db4339428 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance cfe56b3e-2553-4a80-990b-974d4a8d84a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 9a63d50d-5b5b-401e-b6fc-960008baca37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance f0740cc8-0435-43d3-8e8d-c0b05240947e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] No VIF found with MAC fa:16:3e:1e:e1:66, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-96c8141d-1192-46a1-9285-36f2cd72ee5d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.813s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.726s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:02 user nova-compute[73450]: INFO nova.compute.manager [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Detaching volume 5d7a0f96-a16b-4ab9-9a6a-05a71369a62f
Aug 16 16:56:02 user nova-compute[73450]: INFO nova.virt.block_device [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attempting to driver detach volume 5d7a0f96-a16b-4ab9-9a6a-05a71369a62f from mountpoint /dev/vdc
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Attempting to detach device vdc from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:56:02 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:02 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:56:02 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:56:02 user nova-compute[73450]:   <serial>5d7a0f96-a16b-4ab9-9a6a-05a71369a62f</serial>
Aug 16 16:56:02 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 16:56:02 user nova-compute[73450]: </disk>
Aug 16 16:56:02 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:56:02 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Successfully detached device vdc from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the persistent domain config.
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:56:02 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:02 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 16:56:02 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:56:02 user nova-compute[73450]:   <serial>5d7a0f96-a16b-4ab9-9a6a-05a71369a62f</serial>
Aug 16 16:56:02 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 16:56:02 user nova-compute[73450]: </disk>
Aug 16 16:56:02 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692204962.5993154, f0740cc8-0435-43d3-8e8d-c0b05240947e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:56:02 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Successfully detached device vdc from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the live domain config.
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQTonaes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:56:02 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e018d88-e717-4b70-a578-c9f16780114f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10738643-048e-4d0f-8523-d93d01c88516]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f (non-flash)
Aug 16 16:56:02 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:02 user nova-compute[73450]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f (non-flash)
Aug 16 16:56:02 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2702b63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41c53a-1d1b-44ec-8b9b-9f8356adf166]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf36e407-bfc1-4ddb-95ec-f242a27cc33b]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291f6b4-01fa-4ad2-bab9-a9353cf484cb]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a012b7e8-1e70-4aa5-87c6-6b16fd02ddba]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89dbb41-f67a-4a10-997c-004fe9e76c39]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02dd273-588d-4327-9b97-3de6d8e23530]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260]
Aug 16 16:56:02 user nova-compute[73450]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f, portal: 172.16.0.220,3260] successful.
Aug 16 16:56:02 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7a0f96-a16b-4ab9-9a6a-05a71369a62f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4c1d2b-4ea8-4442-a8c2-8ccc0b5dbb64]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] <== disconnect_volume: return (335ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:56:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'flavor' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-5d9c7a3f-6d95-4eab-aa3f-5a31b571dd9d tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.762s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:09 user nova-compute[73450]: INFO nova.compute.manager [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Unshelving
Aug 16 16:56:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:09 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'pci_requests' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:09 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'numa_topology' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:09 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:56:09 user nova-compute[73450]: INFO nova.compute.claims [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Claim successful on node user
Aug 16 16:56:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:10 user nova-compute[73450]: INFO nova.network.neutron [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating port 6619da50-8624-4c5b-a838-615e36ce5fc6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:10 user nova-compute[73450]: INFO nova.compute.manager [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Terminating instance
Aug 16 16:56:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing instance network info cache due to event network-changed-6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-11d28b8d-8ccc-476b-9ba4-1a800a1db5bb req-abd69df3-abc0-4c08-a075-56cebc46a87a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-vif-unplugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-11d28b8d-8ccc-476b-9ba4-1a800a1db5bb req-abd69df3-abc0-4c08-a075-56cebc46a87a service nova] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-11d28b8d-8ccc-476b-9ba4-1a800a1db5bb req-abd69df3-abc0-4c08-a075-56cebc46a87a service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-11d28b8d-8ccc-476b-9ba4-1a800a1db5bb req-abd69df3-abc0-4c08-a075-56cebc46a87a service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-11d28b8d-8ccc-476b-9ba4-1a800a1db5bb req-abd69df3-abc0-4c08-a075-56cebc46a87a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] No waiting events found dispatching network-vif-unplugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-11d28b8d-8ccc-476b-9ba4-1a800a1db5bb req-abd69df3-abc0-4c08-a075-56cebc46a87a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-vif-unplugged-d20f08f0-eaf2-4455-a575-cc94e95e549a for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:56:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Creating image(s)
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'trusted_certs' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.network.neutron [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Refreshing network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "e5b5219960ce686eb28af3d848ee07a680860680" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "e5b5219960ce686eb28af3d848ee07a680860680" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Instance destroyed successfully.
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lazy-loading 'resources' on Instance uuid 0340c20a-c2c8-409f-bd43-0a91880f8f87 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1004582045',display_name='tempest-SnapshotDataIntegrityTests-server-1004582045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1004582045',id=24,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANPGc145a5ACfnoFTKYN6Q02CANqk9EEDtAi4uQfTqQWSzanZoHHP0futeEbXRFN0CGNNmyVA2IFHT6N6hy5Q8COkSuL7nDRlzV9xrB26jND6lgMu56osQkyypzUBur5w==',key_name='tempest-keypair-554288138',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d102b4e156e94b29a674fa550700504e',ramdisk_id='',reservation_id='r-ymu8tr11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-870667565',owner_user_name='tempest-SnapshotDataIntegrityTests-870667565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3751e571d8dc4a90814f4004d66d6d20',uuid=0340c20a-c2c8-409f-bd43-0a91880f8f87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Converting VIF {"id": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "address": "fa:16:3e:60:ff:4b", "network": {"id": "759bcb01-ffb5-443e-b814-62b7d3048f42", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1910574468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d102b4e156e94b29a674fa550700504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20f08f0-ea", "ovs_interfaceid": "d20f08f0-eaf2-4455-a575-cc94e95e549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG os_vif [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20f08f0-ea, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:56:11 user nova-compute[73450]: INFO os_vif [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ff:4b,bridge_name='br-int',has_traffic_filtering=True,id=d20f08f0-eaf2-4455-a575-cc94e95e549a,network=Network(759bcb01-ffb5-443e-b814-62b7d3048f42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20f08f0-ea')
Aug 16 16:56:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Deleting instance files /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87_del
Aug 16 16:56:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Deletion of /opt/stack/data/nova/instances/0340c20a-c2c8-409f-bd43-0a91880f8f87_del complete
Aug 16 16:56:12 user nova-compute[73450]: INFO nova.compute.manager [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 16:56:12 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:56:12 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:56:12 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:56:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG nova.virt.images [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] e82aef58-2436-40a4-aaed-9d677c6d8c22 was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.part /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG nova.network.neutron [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updated VIF entry in instance network info cache for port 6619da50-8624-4c5b-a838-615e36ce5fc6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG nova.network.neutron [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4b3ffd87-db92-4c63-a762-6a44fca2badf req-3b174909-730d-4ba5-afdb-d4dd0ede7f4b service nova] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-5efe4020-8758-431c-8ec7-07df0f5371fa req-5798db7c-5acd-49ec-babe-72ca4f434a8a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5efe4020-8758-431c-8ec7-07df0f5371fa req-5798db7c-5acd-49ec-babe-72ca4f434a8a service nova] Acquiring lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5efe4020-8758-431c-8ec7-07df0f5371fa req-5798db7c-5acd-49ec-babe-72ca4f434a8a service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5efe4020-8758-431c-8ec7-07df0f5371fa req-5798db7c-5acd-49ec-babe-72ca4f434a8a service nova] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-5efe4020-8758-431c-8ec7-07df0f5371fa req-5798db7c-5acd-49ec-babe-72ca4f434a8a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] No waiting events found dispatching network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:13 user nova-compute[73450]: WARNING nova.compute.manager [req-5efe4020-8758-431c-8ec7-07df0f5371fa req-5798db7c-5acd-49ec-babe-72ca4f434a8a service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received unexpected event network-vif-plugged-d20f08f0-eaf2-4455-a575-cc94e95e549a for instance with vm_state active and task_state deleting.
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.part /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.converted" returned: 0 in 0.400s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "e5b5219960ce686eb28af3d848ee07a680860680" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.058s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 --force-share --output=json" returned: 0 in 0.251s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "e5b5219960ce686eb28af3d848ee07a680860680" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "e5b5219960ce686eb28af3d848ee07a680860680" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-b974ca7a-0300-4343-838f-2b647a357909 req-4ace2871-2c53-4527-9ea9-3ac0e8d3328e service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Received event network-vif-deleted-d20f08f0-eaf2-4455-a575-cc94e95e549a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:14 user nova-compute[73450]: INFO nova.compute.manager [req-b974ca7a-0300-4343-838f-2b647a357909 req-4ace2871-2c53-4527-9ea9-3ac0e8d3328e service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Neutron deleted interface d20f08f0-eaf2-4455-a575-cc94e95e549a; detaching it from the instance and deleting it from the info cache
Aug 16 16:56:14 user nova-compute[73450]: DEBUG nova.network.neutron [req-b974ca7a-0300-4343-838f-2b647a357909 req-4ace2871-2c53-4527-9ea9-3ac0e8d3328e service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:14 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Took 1.84 seconds to deallocate network for instance.
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 --force-share --output=json" returned: 0 in 0.245s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680,backing_fmt=raw /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-b974ca7a-0300-4343-838f-2b647a357909 req-4ace2871-2c53-4527-9ea9-3ac0e8d3328e service nova] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Detach interface failed, port_id=d20f08f0-eaf2-4455-a575-cc94e95e549a, reason: Instance 0340c20a-c2c8-409f-bd43-0a91880f8f87 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680,backing_fmt=raw /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk 1073741824" returned: 0 in 0.065s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "e5b5219960ce686eb28af3d848ee07a680860680" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 --force-share --output=json" returned: 0 in 0.227s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'migration_context' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:14 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Rebasing disk image.
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.228s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e -F raw /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:15 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.799s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:15 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Deleted allocations for instance 0340c20a-c2c8-409f-bd43-0a91880f8f87
Aug 16 16:56:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6f7363ee-6524-49a0-b039-8939b343f77f tempest-SnapshotDataIntegrityTests-870667565 tempest-SnapshotDataIntegrityTests-870667565-project-member] Lock "0340c20a-c2c8-409f-bd43-0a91880f8f87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.393s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:16 user nova-compute[73450]: INFO nova.compute.manager [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Terminating instance
Aug 16 16:56:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-9f5afc5c-e289-4a19-a2f4-cfb4df42838f req-b6cc6616-14e1-4bf0-8108-cdc80cdfec49 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9f5afc5c-e289-4a19-a2f4-cfb4df42838f req-b6cc6616-14e1-4bf0-8108-cdc80cdfec49 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9f5afc5c-e289-4a19-a2f4-cfb4df42838f req-b6cc6616-14e1-4bf0-8108-cdc80cdfec49 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9f5afc5c-e289-4a19-a2f4-cfb4df42838f req-b6cc6616-14e1-4bf0-8108-cdc80cdfec49 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-9f5afc5c-e289-4a19-a2f4-cfb4df42838f req-b6cc6616-14e1-4bf0-8108-cdc80cdfec49 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-9f5afc5c-e289-4a19-a2f4-cfb4df42838f req-b6cc6616-14e1-4bf0-8108-cdc80cdfec49 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-unplugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:56:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Instance destroyed successfully.
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'resources' on Instance uuid b1ab59d8-8633-4be5-9fa5-d74e7c34df66 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1851611719',display_name='tempest-AttachVolumeTestJSON-server-1851611719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1851611719',id=22,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1h4A/6J6Fcijzl34bZVu7w4CfoZn+MmIAnWSYwSo1neTQrlfitWgzwa7LLwETWWyoCfNIrkcmLqt77OfBj0AMEhdxSo0/GmXya/6rzR96vac70/JOS4w+9nRm3BeePtg==',key_name='tempest-keypair-890891638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-442g05ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=b1ab59d8-8633-4be5-9fa5-d74e7c34df66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "address": "fa:16:3e:64:3d:a7", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a62f6e8-e0", "ovs_interfaceid": "4a62f6e8-e050-4dae-90ee-7b0724310e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG os_vif [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a62f6e8-e0, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:56:17 user nova-compute[73450]: INFO os_vif [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3d:a7,bridge_name='br-int',has_traffic_filtering=True,id=4a62f6e8-e050-4dae-90ee-7b0724310e90,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a62f6e8-e0')
Aug 16 16:56:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Deleting instance files /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66_del
Aug 16 16:56:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Deletion of /opt/stack/data/nova/instances/b1ab59d8-8633-4be5-9fa5-d74e7c34df66_del complete
Aug 16 16:56:17 user nova-compute[73450]: INFO nova.compute.manager [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 16 16:56:17 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e -F raw /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk" returned: 0 in 2.579s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Ensure instance console log exists: /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Start _get_guest_xml network_info=[{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='681c1a565ee472ccdf061b35d079aacf',container_format='bare',created_at=2023-08-16T16:54:16Z,direct_url=<?>,disk_format='qcow2',id=e82aef58-2436-40a4-aaed-9d677c6d8c22,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-82395713-shelved',owner='c6dfde9621b946408c11bcf2465a9a3d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T16:54:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:56:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:56:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='681c1a565ee472ccdf061b35d079aacf',container_format='bare',created_at=2023-08-16T16:54:16Z,direct_url=<?>,disk_format='qcow2',id=e82aef58-2436-40a4-aaed-9d677c6d8c22,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-82395713-shelved',owner='c6dfde9621b946408c11bcf2465a9a3d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T16:54:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-82395713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-82395713',id=32,image_ref='e82aef58-2436-40a4-aaed-9d677c6d8c22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2132504027',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-r4x0kwml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member',shelved_at='2023-08-16T16:54:21.130849',shelved_host='user',shelved_image_id='e82aef58-2436-40a4-aaed-9d677c6d8c22'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=032b05e3-0db8-4029-9764-9fcce2eb55a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'pci_devices' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:56:17 user nova-compute[73450]:   <uuid>032b05e3-0db8-4029-9764-9fcce2eb55a7</uuid>
Aug 16 16:56:17 user nova-compute[73450]:   <name>instance-00000020</name>
Aug 16 16:56:17 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:56:17 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:56:17 user nova-compute[73450]:   <metadata>
Aug 16 16:56:17 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:56:17 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:56:17 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-82395713</nova:name>
Aug 16 16:56:17 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:56:17</nova:creationTime>
Aug 16 16:56:17 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:56:17 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:56:17 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:56:17 user nova-compute[73450]:       <nova:owner>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:user uuid="2ed98f68e9e04991817ddf00c2c3cb0e">tempest-AttachVolumeShelveTestJSON-405972124-project-member</nova:user>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:project uuid="c6dfde9621b946408c11bcf2465a9a3d">tempest-AttachVolumeShelveTestJSON-405972124</nova:project>
Aug 16 16:56:17 user nova-compute[73450]:       </nova:owner>
Aug 16 16:56:17 user nova-compute[73450]:       <nova:root type="image" uuid="e82aef58-2436-40a4-aaed-9d677c6d8c22"/>
Aug 16 16:56:17 user nova-compute[73450]:       <nova:ports>
Aug 16 16:56:17 user nova-compute[73450]:         <nova:port uuid="6619da50-8624-4c5b-a838-615e36ce5fc6">
Aug 16 16:56:17 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 16:56:17 user nova-compute[73450]:         </nova:port>
Aug 16 16:56:17 user nova-compute[73450]:       </nova:ports>
Aug 16 16:56:17 user nova-compute[73450]:     </nova:instance>
Aug 16 16:56:17 user nova-compute[73450]:   </metadata>
Aug 16 16:56:17 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:56:17 user nova-compute[73450]:     <system>
Aug 16 16:56:17 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:56:17 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:56:17 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:56:17 user nova-compute[73450]:       <entry name="serial">032b05e3-0db8-4029-9764-9fcce2eb55a7</entry>
Aug 16 16:56:17 user nova-compute[73450]:       <entry name="uuid">032b05e3-0db8-4029-9764-9fcce2eb55a7</entry>
Aug 16 16:56:17 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:56:17 user nova-compute[73450]:     </system>
Aug 16 16:56:17 user nova-compute[73450]:   </sysinfo>
Aug 16 16:56:17 user nova-compute[73450]:   <os>
Aug 16 16:56:17 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:56:17 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:56:17 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:56:17 user nova-compute[73450]:   </os>
Aug 16 16:56:17 user nova-compute[73450]:   <features>
Aug 16 16:56:17 user nova-compute[73450]:     <acpi/>
Aug 16 16:56:17 user nova-compute[73450]:     <apic/>
Aug 16 16:56:17 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:56:17 user nova-compute[73450]:   </features>
Aug 16 16:56:17 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:56:17 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:56:17 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:56:17 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:56:17 user nova-compute[73450]:   </clock>
Aug 16 16:56:17 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:56:17 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:56:17 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:56:17 user nova-compute[73450]:   </cpu>
Aug 16 16:56:17 user nova-compute[73450]:   <devices>
Aug 16 16:56:17 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:56:17 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:56:17 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk"/>
Aug 16 16:56:17 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:56:17 user nova-compute[73450]:     </disk>
Aug 16 16:56:17 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:56:17 user nova-compute[73450]:       <mac address="fa:16:3e:fd:2e:34"/>
Aug 16 16:56:17 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:56:17 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:56:17 user nova-compute[73450]:       <target dev="tap6619da50-86"/>
Aug 16 16:56:17 user nova-compute[73450]:     </interface>
Aug 16 16:56:17 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:56:17 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/console.log" append="off"/>
Aug 16 16:56:17 user nova-compute[73450]:     </serial>
Aug 16 16:56:17 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:56:17 user nova-compute[73450]:     <video>
Aug 16 16:56:17 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:56:17 user nova-compute[73450]:     </video>
Aug 16 16:56:17 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:56:17 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:56:17 user nova-compute[73450]:     </rng>
Aug 16 16:56:17 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:56:17 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:56:17 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:56:17 user nova-compute[73450]:     </memballoon>
Aug 16 16:56:17 user nova-compute[73450]:   </devices>
Aug 16 16:56:17 user nova-compute[73450]: </domain>
Aug 16 16:56:17 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-82395713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-82395713',id=32,image_ref='e82aef58-2436-40a4-aaed-9d677c6d8c22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2132504027',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-r4x0kwml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member',shelved_at='2023-08-16T16:54:21.130849',shelved_host='user',shelved_image_id='e82aef58-2436-40a4-aaed-9d677c6d8c22'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=032b05e3-0db8-4029-9764-9fcce2eb55a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG os_vif [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6619da50-86, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6619da50-86, col_values=(('external_ids', {'iface-id': '6619da50-8624-4c5b-a838-615e36ce5fc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:2e:34', 'vm-uuid': '032b05e3-0db8-4029-9764-9fcce2eb55a7'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:17 user nova-compute[73450]: INFO os_vif [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86')
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:56:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] No VIF found with MAC fa:16:3e:fd:2e:34, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:18 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Took 0.90 seconds to deallocate network for instance.
Aug 16 16:56:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-bb34581c-20b1-43c2-9b4a-123626b0efc8 req-eb083851-e333-4de4-9810-9b4a2cd503f9 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-deleted-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:18 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Deleted allocations for instance b1ab59d8-8633-4be5-9fa5-d74e7c34df66
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d4958d1a-051d-4fb7-ab5e-3a3dfebf6b81 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-a1814b01-587d-4b60-b562-a7b31cfeaf16 req-fe11c260-7cae-4e8f-bf0d-13aa738b4579 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a1814b01-587d-4b60-b562-a7b31cfeaf16 req-fe11c260-7cae-4e8f-bf0d-13aa738b4579 service nova] Acquiring lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a1814b01-587d-4b60-b562-a7b31cfeaf16 req-fe11c260-7cae-4e8f-bf0d-13aa738b4579 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a1814b01-587d-4b60-b562-a7b31cfeaf16 req-fe11c260-7cae-4e8f-bf0d-13aa738b4579 service nova] Lock "b1ab59d8-8633-4be5-9fa5-d74e7c34df66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-a1814b01-587d-4b60-b562-a7b31cfeaf16 req-fe11c260-7cae-4e8f-bf0d-13aa738b4579 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] No waiting events found dispatching network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:18 user nova-compute[73450]: WARNING nova.compute.manager [req-a1814b01-587d-4b60-b562-a7b31cfeaf16 req-fe11c260-7cae-4e8f-bf0d-13aa738b4579 service nova] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Received unexpected event network-vif-plugged-4a62f6e8-e050-4dae-90ee-7b0724310e90 for instance with vm_state deleted and task_state None.
Aug 16 16:56:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-da004a44-69ec-40d5-9f8f-6db9aa9dcda1 req-7fa7e4df-7c06-498d-adf4-e9e8b2fedc8e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-da004a44-69ec-40d5-9f8f-6db9aa9dcda1 req-7fa7e4df-7c06-498d-adf4-e9e8b2fedc8e service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-da004a44-69ec-40d5-9f8f-6db9aa9dcda1 req-7fa7e4df-7c06-498d-adf4-e9e8b2fedc8e service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-da004a44-69ec-40d5-9f8f-6db9aa9dcda1 req-7fa7e4df-7c06-498d-adf4-e9e8b2fedc8e service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-da004a44-69ec-40d5-9f8f-6db9aa9dcda1 req-7fa7e4df-7c06-498d-adf4-e9e8b2fedc8e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:19 user nova-compute[73450]: WARNING nova.compute.manager [req-da004a44-69ec-40d5-9f8f-6db9aa9dcda1 req-7fa7e4df-7c06-498d-adf4-e9e8b2fedc8e service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 16:56:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204981.1751041, 032b05e3-0db8-4029-9764-9fcce2eb55a7 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:56:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] VM Resumed (Lifecycle Event)
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-62fea2a6-2d11-44e8-97b3-389f53bd67dc req-6c2978bf-c85f-4d5f-b3eb-0b8b4c30f35f service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62fea2a6-2d11-44e8-97b3-389f53bd67dc req-6c2978bf-c85f-4d5f-b3eb-0b8b4c30f35f service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62fea2a6-2d11-44e8-97b3-389f53bd67dc req-6c2978bf-c85f-4d5f-b3eb-0b8b4c30f35f service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62fea2a6-2d11-44e8-97b3-389f53bd67dc req-6c2978bf-c85f-4d5f-b3eb-0b8b4c30f35f service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-62fea2a6-2d11-44e8-97b3-389f53bd67dc req-6c2978bf-c85f-4d5f-b3eb-0b8b4c30f35f service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:21 user nova-compute[73450]: WARNING nova.compute.manager [req-62fea2a6-2d11-44e8-97b3-389f53bd67dc req-6c2978bf-c85f-4d5f-b3eb-0b8b4c30f35f service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 16:56:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance spawned successfully.
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:56:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692204981.1766932, 032b05e3-0db8-4029-9764-9fcce2eb55a7 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:56:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] VM Started (Lifecycle Event)
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:56:21 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:56:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:56:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b729038f-5b65-4d0e-be50-b4ef0a2439da tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.262s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:25 user nova-compute[73450]: INFO nova.compute.manager [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Terminating instance
Aug 16 16:56:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-67e16810-7548-4d26-a714-9bcbcf387ec0 req-b4365d42-3dc3-434e-99fe-ed63736cf797 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-vif-unplugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-67e16810-7548-4d26-a714-9bcbcf387ec0 req-b4365d42-3dc3-434e-99fe-ed63736cf797 service nova] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-67e16810-7548-4d26-a714-9bcbcf387ec0 req-b4365d42-3dc3-434e-99fe-ed63736cf797 service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-67e16810-7548-4d26-a714-9bcbcf387ec0 req-b4365d42-3dc3-434e-99fe-ed63736cf797 service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-67e16810-7548-4d26-a714-9bcbcf387ec0 req-b4365d42-3dc3-434e-99fe-ed63736cf797 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] No waiting events found dispatching network-vif-unplugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-67e16810-7548-4d26-a714-9bcbcf387ec0 req-b4365d42-3dc3-434e-99fe-ed63736cf797 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-vif-unplugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:56:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Instance destroyed successfully.
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'resources' on Instance uuid 9a63d50d-5b5b-401e-b6fc-960008baca37 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-695182127',display_name='tempest-TestVolumeBootPattern-volume-backed-server-695182127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-695182127',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGGq5nJSF3Kc3FFDpfeDSFav4Ck9R9/RI6KY4FHLqpORzDT5oYPJ7cWHV/30yPzOcK+k6sr4yb5NEMan1X6O5MZANW9+PqzlHszQo68dSgAhaQnTlc5H4nybcJJYqYXVA==',key_name='tempest-keypair-1585604788',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-3umzyb0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=9a63d50d-5b5b-401e-b6fc-960008baca37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "address": "fa:16:3e:2c:6b:7b", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4045fc-71", "ovs_interfaceid": "bd4045fc-71f0-402d-bc5c-cd447d7731a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_vif [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd4045fc-71, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:26 user nova-compute[73450]: INFO os_vif [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:6b:7b,bridge_name='br-int',has_traffic_filtering=True,id=bd4045fc-71f0-402d-bc5c-cd447d7731a6,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4045fc-71')
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUAQXGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:56:26 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf8774-1182-41fa-bf35-0f88ab84f835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0635d3d6-2ae5-4437-9bce-3db634c31522]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:26 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe280193640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.050s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816e3b6-e47b-4fe6-8517-9ec1d85db488]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2def231c-da54-4e89-8ed3-3c46ff1999fb]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204971.7182348, 0340c20a-c2c8-409f-bd43-0a91880f8f87 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:56:26 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] VM Stopped (Lifecycle Event)
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83f698-154a-4601-b4a1-b115a02eccb1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fb8c89ab-d5f2-46cf-a977-602e3d8fbcfa None None] [instance: 0340c20a-c2c8-409f-bd43-0a91880f8f87] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4081d9-25a7-4e3d-bf01-94b8521c7041]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_319bab26',) {{(pid=84237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4688431-50d5-4fe7-88ef-95d210592add]: (4, None) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d1c8c-6aa7-4eb0-aaab-5f04d457dcfa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967f75b-f62d-4ceb-8840-d067f44de0ec]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260]
Aug 16 16:56:26 user nova-compute[73450]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e, portal: 172.16.0.220,3260] successful.
Aug 16 16:56:26 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e49dfcc-137c-4c22-a3c6-96dc5fb6163e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c93727-a366-41f5-8fef-06981079e68f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== disconnect_volume: return (347ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:56:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Deleting instance files /opt/stack/data/nova/instances/9a63d50d-5b5b-401e-b6fc-960008baca37_del
Aug 16 16:56:26 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Deletion of /opt/stack/data/nova/instances/9a63d50d-5b5b-401e-b6fc-960008baca37_del complete
Aug 16 16:56:26 user nova-compute[73450]: INFO nova.compute.manager [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 16 16:56:26 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:56:26 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:56:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-53fadad5-e40b-459b-8428-9ce1a50e33a3 req-627eb537-b25c-48ae-ab11-ecb2113ced58 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-53fadad5-e40b-459b-8428-9ce1a50e33a3 req-627eb537-b25c-48ae-ab11-ecb2113ced58 service nova] Acquiring lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-53fadad5-e40b-459b-8428-9ce1a50e33a3 req-627eb537-b25c-48ae-ab11-ecb2113ced58 service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-53fadad5-e40b-459b-8428-9ce1a50e33a3 req-627eb537-b25c-48ae-ab11-ecb2113ced58 service nova] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-53fadad5-e40b-459b-8428-9ce1a50e33a3 req-627eb537-b25c-48ae-ab11-ecb2113ced58 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] No waiting events found dispatching network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:28 user nova-compute[73450]: WARNING nova.compute.manager [req-53fadad5-e40b-459b-8428-9ce1a50e33a3 req-627eb537-b25c-48ae-ab11-ecb2113ced58 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received unexpected event network-vif-plugged-bd4045fc-71f0-402d-bc5c-cd447d7731a6 for instance with vm_state active and task_state deleting.
Aug 16 16:56:28 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:28 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Took 1.28 seconds to deallocate network for instance.
Aug 16 16:56:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-f70d0a1c-bb68-4b9e-8ef0-5334bb2ca1b2 req-8f9a1414-55e7-40d2-85de-7a4c99e0eb37 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Received event network-vif-deleted-bd4045fc-71f0-402d-bc5c-cd447d7731a6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:28 user nova-compute[73450]: INFO nova.compute.manager [req-f70d0a1c-bb68-4b9e-8ef0-5334bb2ca1b2 req-8f9a1414-55e7-40d2-85de-7a4c99e0eb37 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Neutron deleted interface bd4045fc-71f0-402d-bc5c-cd447d7731a6; detaching it from the instance and deleting it from the info cache
Aug 16 16:56:28 user nova-compute[73450]: DEBUG nova.network.neutron [req-f70d0a1c-bb68-4b9e-8ef0-5334bb2ca1b2 req-8f9a1414-55e7-40d2-85de-7a4c99e0eb37 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-f70d0a1c-bb68-4b9e-8ef0-5334bb2ca1b2 req-8f9a1414-55e7-40d2-85de-7a4c99e0eb37 service nova] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Detach interface failed, port_id=bd4045fc-71f0-402d-bc5c-cd447d7731a6, reason: Instance 9a63d50d-5b5b-401e-b6fc-960008baca37 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:56:29 user nova-compute[73450]: INFO nova.compute.manager [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 16:56:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Deleting volume: 6e49dfcc-137c-4c22-a3c6-96dc5fb6163e {{(pid=73450) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 16:56:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:29 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:29 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:29 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Deleted allocations for instance 9a63d50d-5b5b-401e-b6fc-960008baca37
Aug 16 16:56:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-37fda9fa-b103-415b-a7bf-347f6394d905 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "9a63d50d-5b5b-401e-b6fc-960008baca37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.891s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:32 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204977.0449595, b1ab59d8-8633-4be5-9fa5-d74e7c34df66 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:56:32 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] VM Stopped (Lifecycle Event)
Aug 16 16:56:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-91f29283-abd5-4ad5-9efc-7124f9e87e36 None None] [instance: b1ab59d8-8633-4be5-9fa5-d74e7c34df66] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:56:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:41 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692204986.5084429, 9a63d50d-5b5b-401e-b6fc-960008baca37 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:56:41 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] VM Stopped (Lifecycle Event)
Aug 16 16:56:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-25ae4f7a-ce66-49de-aedc-69ae3360dc01 None None] [instance: 9a63d50d-5b5b-401e-b6fc-960008baca37] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:56:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:46 user nova-compute[73450]: INFO nova.compute.manager [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Terminating instance
Aug 16 16:56:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4b0315a-1c15-4bf5-9811-83c955b7240e req-c32a42a2-2d39-4d66-aa29-79e18a6ea16e service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-unplugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4b0315a-1c15-4bf5-9811-83c955b7240e req-c32a42a2-2d39-4d66-aa29-79e18a6ea16e service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4b0315a-1c15-4bf5-9811-83c955b7240e req-c32a42a2-2d39-4d66-aa29-79e18a6ea16e service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f4b0315a-1c15-4bf5-9811-83c955b7240e req-c32a42a2-2d39-4d66-aa29-79e18a6ea16e service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4b0315a-1c15-4bf5-9811-83c955b7240e req-c32a42a2-2d39-4d66-aa29-79e18a6ea16e service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-unplugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-f4b0315a-1c15-4bf5-9811-83c955b7240e req-c32a42a2-2d39-4d66-aa29-79e18a6ea16e service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-unplugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:56:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Instance destroyed successfully.
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'resources' on Instance uuid cfe56b3e-2553-4a80-990b-974d4a8d84a1 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167881879',display_name='tempest-TestMinimumBasicScenario-server-1167881879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167881879',id=30,image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvpuiF/GcK+jBYxfRiaZkIdPRIBolZ2O5+5duCiC4VDIg25CdFE52GrAtZgEdNyH9sNHH9uY4Lr0Pt3q/cMXVrSYvduWJYWl2r4RGsnGkMi+BprC8rFWeVSXAHrxuvnFw==',key_name='tempest-TestMinimumBasicScenario-20692004',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-1vfwhcwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a957b4-d282-4a04-bbe6-aeef51b5d19a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:54:05Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=cfe56b3e-2553-4a80-990b-974d4a8d84a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "address": "fa:16:3e:c8:de:4f", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad991858-4f", "ovs_interfaceid": "ad991858-4f5a-4176-99b9-fcc0c75c91b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG os_vif [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad991858-4f, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:56:47 user nova-compute[73450]: INFO os_vif [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:de:4f,bridge_name='br-int',has_traffic_filtering=True,id=ad991858-4f5a-4176-99b9-fcc0c75c91b4,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad991858-4f')
Aug 16 16:56:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Deleting instance files /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1_del
Aug 16 16:56:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Deletion of /opt/stack/data/nova/instances/cfe56b3e-2553-4a80-990b-974d4a8d84a1_del complete
Aug 16 16:56:47 user nova-compute[73450]: INFO nova.compute.manager [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 16:56:47 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:56:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:48 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:48 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Took 0.61 seconds to deallocate network for instance.
Aug 16 16:56:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:48 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:48 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:48 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Deleted allocations for instance cfe56b3e-2553-4a80-990b-974d4a8d84a1
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b2f4549d-4c22-4229-8a4a-5d23369bf676 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Acquiring lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Lock "cfe56b3e-2553-4a80-990b-974d4a8d84a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] No waiting events found dispatching network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:49 user nova-compute[73450]: WARNING nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received unexpected event network-vif-plugged-ad991858-4f5a-4176-99b9-fcc0c75c91b4 for instance with vm_state deleted and task_state None.
Aug 16 16:56:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Received event network-vif-deleted-ad991858-4f5a-4176-99b9-fcc0c75c91b4 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-changed-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing instance network info cache due to event network-changed-ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing network info cache for port ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:49 user nova-compute[73450]: INFO nova.compute.manager [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Detaching volume 8a14db3e-01bf-4eed-9b14-e9f8124af96a
Aug 16 16:56:50 user nova-compute[73450]: INFO nova.virt.block_device [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Attempting to driver detach volume 8a14db3e-01bf-4eed-9b14-e9f8124af96a from mountpoint /dev/vdb
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Attempting to detach device vdb from instance a36f0a56-ed4a-4593-8c78-f71a53938fec from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:56:50 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:50 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:56:50 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:56:50 user nova-compute[73450]:   <serial>8a14db3e-01bf-4eed-9b14-e9f8124af96a</serial>
Aug 16 16:56:50 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:56:50 user nova-compute[73450]: </disk>
Aug 16 16:56:50 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:56:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully detached device vdb from instance a36f0a56-ed4a-4593-8c78-f71a53938fec from the persistent domain config.
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a36f0a56-ed4a-4593-8c78-f71a53938fec from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:56:50 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:50 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:56:50 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:56:50 user nova-compute[73450]:   <serial>8a14db3e-01bf-4eed-9b14-e9f8124af96a</serial>
Aug 16 16:56:50 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:56:50 user nova-compute[73450]: </disk>
Aug 16 16:56:50 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updated VIF entry in instance network info cache for port ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-changed-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing instance network info cache due to event network-changed-ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Acquiring lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Acquired lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Refreshing network info cache for port ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205010.4892101, a36f0a56-ed4a-4593-8c78-f71a53938fec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:56:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully detached device vdb from instance a36f0a56-ed4a-4593-8c78-f71a53938fec from the live domain config.
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PoLturYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:56:50 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae515273-b407-4bfc-a8a5-e1563d6e05de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08d35e-8d57-42b3-9824-6e018fe5a5e0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:50 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe25060a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f4b64-7ed3-42a2-bcb4-1089df6d7cfd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2f361-1443-42a8-9532-00b58bde3a47]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c45368-d1e1-45c3-93cb-114083b68646]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updated VIF entry in instance network info cache for port ceda7838-2709-4eec-be04-e29e1127982b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [{"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1cd1fddc-90d1-4e50-9930-c898f773f13a req-c669a510-5c45-4cac-8401-25056fa26117 service nova] Releasing lock "refresh_cache-a36f0a56-ed4a-4593-8c78-f71a53938fec" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[31685beb-1ef2-4889-ab6b-c869bf484196]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bee6a79-e8dc-4253-8ce6-e14ff5a743cd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac13a2-247b-4c07-a96c-f1e8079cad43]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260]
Aug 16 16:56:50 user nova-compute[73450]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a, portal: 172.16.0.220,3260] successful.
Aug 16 16:56:50 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14db3e-01bf-4eed-9b14-e9f8124af96a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12c5a0-d237-4d7d-b647-30bf924eb2d5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] <== disconnect_volume: return (295ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:51 user nova-compute[73450]: INFO nova.compute.manager [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Terminating instance
Aug 16 16:56:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'flavor' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7388edfb-8166-4098-9b88-3283a2085da4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-0f2ad8f6-2155-42b3-b077-fb64c0fe7de4 req-9dfadc6e-9835-4b3f-a8b6-46868741015f service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0f2ad8f6-2155-42b3-b077-fb64c0fe7de4 req-9dfadc6e-9835-4b3f-a8b6-46868741015f service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0f2ad8f6-2155-42b3-b077-fb64c0fe7de4 req-9dfadc6e-9835-4b3f-a8b6-46868741015f service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0f2ad8f6-2155-42b3-b077-fb64c0fe7de4 req-9dfadc6e-9835-4b3f-a8b6-46868741015f service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-0f2ad8f6-2155-42b3-b077-fb64c0fe7de4 req-9dfadc6e-9835-4b3f-a8b6-46868741015f service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-0f2ad8f6-2155-42b3-b077-fb64c0fe7de4 req-9dfadc6e-9835-4b3f-a8b6-46868741015f service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Instance destroyed successfully.
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'resources' on Instance uuid 5104e1fc-bcbb-4643-9d66-6f0db4339428 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2097810802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2097810802',id=29,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-ujbswy8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:55:08Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=5104e1fc-bcbb-4643-9d66-6f0db4339428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "address": "fa:16:3e:07:fa:9c", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02a931-7a", "ovs_interfaceid": "ca02a931-7ab6-4e5f-8345-670aea6eedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_vif [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca02a931-7a, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:56:52 user nova-compute[73450]: INFO os_vif [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:fa:9c,bridge_name='br-int',has_traffic_filtering=True,id=ca02a931-7ab6-4e5f-8345-670aea6eedab,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02a931-7a')
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kREIuKXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:56:52 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac655437-98ad-4eba-bec6-0a3c4322bb4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caf808e-79b5-4ea8-8da6-a9c69436855c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:52 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:52 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:52 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:52 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:52 user nova-compute[73450]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d (non-flash)
Aug 16 16:56:52 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:52 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:52 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe250683b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3455667e-2d21-4c99-8188-f50980866e3d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999792b-c6eb-4520-a144-f568ad986da3]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca2835-21bc-4311-9a53-d15fe5441bf0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da16c0-ba80-4f01-9a48-143f5d23fe67]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ce93e03', '/dev/disk/by-id/scsi-26161633565366531', '/dev/disk/by-id/scsi-1SCST_BIO4ce93e03-aac5e6e174eb9cea') {{(pid=84237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00329df-bd76-4cbe-af67-346184783374]: (4, None) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebef50f1-5e37-4eec-8c62-82e66d8dd214]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca44b6-a71d-4615-a660-87f8d869453a]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260]
Aug 16 16:56:52 user nova-compute[73450]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d, portal: 172.16.0.220,3260] successful.
Aug 16 16:56:52 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382bea4f-adac-453a-9c86-539b1d170d4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6836f39d-b50c-47b6-9080-310eafecb33b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== disconnect_volume: return (390ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Deleting instance files /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428_del
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Deletion of /opt/stack/data/nova/instances/5104e1fc-bcbb-4643-9d66-6f0db4339428_del complete
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.compute.manager [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.compute.manager [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Detaching volume 32dfbb40-5fd0-4f98-b60d-958fc1963ec5
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.virt.block_device [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Attempting to driver detach volume 32dfbb40-5fd0-4f98-b60d-958fc1963ec5 from mountpoint /dev/vdb
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Attempting to detach device vdb from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:56:52 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:52 user nova-compute[73450]:   <source dev="/dev/sdf"/>
Aug 16 16:56:52 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:56:52 user nova-compute[73450]:   <serial>32dfbb40-5fd0-4f98-b60d-958fc1963ec5</serial>
Aug 16 16:56:52 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:56:52 user nova-compute[73450]: </disk>
Aug 16 16:56:52 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:56:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Successfully detached device vdb from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the persistent domain config.
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:56:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:56:52 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:56:52 user nova-compute[73450]:   <source dev="/dev/sdf"/>
Aug 16 16:56:52 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:56:52 user nova-compute[73450]:   <serial>32dfbb40-5fd0-4f98-b60d-958fc1963ec5</serial>
Aug 16 16:56:52 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:56:52 user nova-compute[73450]: </disk>
Aug 16 16:56:52 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205013.4499516, f0740cc8-0435-43d3-8e8d-c0b05240947e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:56:53 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Successfully detached device vdb from instance f0740cc8-0435-43d3-8e8d-c0b05240947e from the live domain config.
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHwEJlcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:56:53 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194fb8a-e6cf-480b-8639-b97bf99004b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fcb2d9-10fa-4564-ba2d-607a402304e6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:53 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:53 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:53 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:53 user nova-compute[73450]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 (non-flash)
Aug 16 16:56:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2507b6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5'): ({'sdf'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Removing single pathed devices sdf {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-changed-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Refreshing instance network info cache due to event network-changed-77f40a61-d7ad-4a05-81bc-c24b58ba65f6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.network.neutron [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Refreshing network info cache for port 77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:56:53 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Took 0.87 seconds to deallocate network for instance.
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccebe3e0-2d29-4ab8-89df-4ef6c2e40f63]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-b78f3412-7306-4a99-84d5-88376da37297 req-074fbfb0-f2bf-4e9d-97ee-285dbb891ba4 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-deleted-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382ba73-edf9-4e44-9fb7-3445a15779ca]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Flushing IO for device /dev/sdf {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[094dc02e-f3bb-42e7-9c63-1daf7c3f14c3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e081e-bd0d-4ae5-b815-8441bac8de90]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] SCSI volumes sdf have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[97110c81-5dc7-4cc5-a287-eae076a3f85b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee0c2d-cf2f-465c-ac4e-2d63d87f89a7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260]
Aug 16 16:56:53 user nova-compute[73450]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5, portal: 172.16.0.220,3260] successful.
Aug 16 16:56:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32dfbb40-5fd0-4f98-b60d-958fc1963ec5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b25a84-8797-4369-a381-68d68de0b691]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] <== disconnect_volume: return (305ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:54 user nova-compute[73450]: WARNING nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state deleting.
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:54 user nova-compute[73450]: WARNING nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state deleting.
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:54 user nova-compute[73450]: WARNING nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state deleting.
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-unplugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Acquiring lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] No waiting events found dispatching network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:54 user nova-compute[73450]: WARNING nova.compute.manager [req-5eee7fbc-21b6-47cd-bc4b-5560e47eacd1 req-5fa77c03-347f-4fd2-95be-682f396471e2 service nova] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Received unexpected event network-vif-plugged-ca02a931-7ab6-4e5f-8345-670aea6eedab for instance with vm_state active and task_state deleting.
Aug 16 16:56:54 user nova-compute[73450]: INFO nova.compute.manager [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Took 0.84 seconds to detach 1 volumes for instance.
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.network.neutron [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updated VIF entry in instance network info cache for port 77f40a61-d7ad-4a05-81bc-c24b58ba65f6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.network.neutron [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4a3cb8a9-5519-4b9b-ba08-2eda5350dffd req-632caf5d-02d9-473f-a5e0-8145220cfc14 service nova] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.objects.instance [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'flavor' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ce115a23-4646-42fe-b872-f4e59981b0b2 tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:54 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Deleted allocations for instance 5104e1fc-bcbb-4643-9d66-6f0db4339428
Aug 16 16:56:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-f175fcd7-1d9e-4ba6-b801-ce6c28fbf2cb tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "5104e1fc-bcbb-4643-9d66-6f0db4339428" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.395s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-changed-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Refreshing instance network info cache due to event network-changed-c5752bbb-fe02-446e-a096-3d0388da13be. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Refreshing network info cache for port c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Stashing vm_state: active {{(pid=73450) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_requests' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:56:55 user nova-compute[73450]: INFO nova.compute.claims [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Claim successful on node user
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'resources' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'pci_devices' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:56:55 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating resource usage from migration aff104b8-8f41-4d1b-831e-579df4f97277
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updated VIF entry in instance network info cache for port c5752bbb-fe02-446e-a096-3d0388da13be. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.network.neutron [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c721f1e8-b255-45c2-9bd0-67a88102c00f req-81789e02-d086-4b7e-a4e3-8c31c8fbdf1a service nova] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.461s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:56 user nova-compute[73450]: INFO nova.compute.manager [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Migrating
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.072s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:56:56 user nova-compute[73450]: INFO nova.compute.rpcapi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Starting migrate_disk_and_power_off {{(pid=73450) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-b09746ee-8eb5-4edc-81b3-5a1445469714 req-6b282342-85e8-4f92-a31c-d0a96f93d452 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-unplugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b09746ee-8eb5-4edc-81b3-5a1445469714 req-6b282342-85e8-4f92-a31c-d0a96f93d452 service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b09746ee-8eb5-4edc-81b3-5a1445469714 req-6b282342-85e8-4f92-a31c-d0a96f93d452 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b09746ee-8eb5-4edc-81b3-5a1445469714 req-6b282342-85e8-4f92-a31c-d0a96f93d452 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-b09746ee-8eb5-4edc-81b3-5a1445469714 req-6b282342-85e8-4f92-a31c-d0a96f93d452 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-unplugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:57 user nova-compute[73450]: WARNING nova.compute.manager [req-b09746ee-8eb5-4edc-81b3-5a1445469714 req-6b282342-85e8-4f92-a31c-d0a96f93d452 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-unplugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state active and task_state resize_migrating.
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance destroyed successfully.
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1646450735',display_name='tempest-ServerActionsTestOtherA-server-1646450735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1646450735',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-60302x42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=5df06efe-b1d6-470e-a230-bf63734642f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5752bbb-fe, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:56:57 user nova-compute[73450]: INFO os_vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe')
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:56:57 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d81f03-4d7e-4bc2-8c57-08e9099d18c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f085d4-f7ca-40aa-9b3f-7ef05e2f4f0f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:57 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:56:57 user nova-compute[73450]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:56:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe28015dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'): ({'sdg'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Removing single pathed devices sdg {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[76467c84-536b-480f-99df-62293bea9244]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fabacf-d5b7-4f00-afc9-219ef28150ef]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flushing IO for device /dev/sdg {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ebff44-86d6-4506-8507-e5301aa41c51]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:56:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.109s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[244a7d19-1bcf-45be-8636-b87cc96aa2c7]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] SCSI volumes sdg have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b19f7-2033-4136-a9dc-aa07fa67990e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8a2a30-504d-49ca-a153-6bb41c63562d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]
Aug 16 16:56:58 user nova-compute[73450]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.
Aug 16 16:56:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3b9315-9b83-4dcf-81c1-f87e7bd460dd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== disconnect_volume: return (403ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Port c5752bbb-fe02-446e-a096-3d0388da13be binding to destination host user is already ACTIVE {{(pid=73450) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c861231-c84b-4740-a6e3-284b655660eb req-fd2eeef0-bcd5-4324-bf48-d71357c500b4 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c861231-c84b-4740-a6e3-284b655660eb req-fd2eeef0-bcd5-4324-bf48-d71357c500b4 service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c861231-c84b-4740-a6e3-284b655660eb req-fd2eeef0-bcd5-4324-bf48-d71357c500b4 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9c861231-c84b-4740-a6e3-284b655660eb req-fd2eeef0-bcd5-4324-bf48-d71357c500b4 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-9c861231-c84b-4740-a6e3-284b655660eb req-fd2eeef0-bcd5-4324-bf48-d71357c500b4 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:56:59 user nova-compute[73450]: WARNING nova.compute.manager [req-9c861231-c84b-4740-a6e3-284b655660eb req-fd2eeef0-bcd5-4324-bf48-d71357c500b4 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state active and task_state resize_migrating.
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:56:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.network.neutron [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG os_brick.utils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ca1bc-e062-488d-a73c-afa1bd955f48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac98cf-2a92-4a13-bf3c-0b9aa39a2113]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7114c-6725-4486-9484-6e356bd88816]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[089090c3-1f37-479a-9ac1-4f36f445cf2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7181MB free_disk=23.66073989868164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:57:00 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:57:00 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457cbb9-6176-4bea-af78-fe92bd8f268c]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG os_brick.utils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== get_connector_properties: return (531ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Applying migration context for instance 5df06efe-b1d6-470e-a230-bf63734642f5 as it has an incoming, in-progress migration aff104b8-8f41-4d1b-831e-579df4f97277. Migration status is post-migrating {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 16:57:00 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating resource usage from migration aff104b8-8f41-4d1b-831e-579df4f97277
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a36f0a56-ed4a-4593-8c78-f71a53938fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance f0740cc8-0435-43d3-8e8d-c0b05240947e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032b05e3-0db8-4029-9764-9fcce2eb55a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Migration aff104b8-8f41-4d1b-831e-579df4f97277 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:57:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:57:01 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:01 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:57:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:02 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205007.7063105, cfe56b3e-2553-4a80-990b-974d4a8d84a1 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:02 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] VM Stopped (Lifecycle Event)
Aug 16 16:57:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b0ead8ee-bc36-492f-9d59-0ee89360f3dd None None] [instance: cfe56b3e-2553-4a80-990b-974d4a8d84a1] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:57:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:07 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205012.1361494, 5104e1fc-bcbb-4643-9d66-6f0db4339428 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:07 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] VM Stopped (Lifecycle Event)
Aug 16 16:57:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-187d1422-606e-4e7d-a691-967e60c40d93 None None] [instance: 5104e1fc-bcbb-4643-9d66-6f0db4339428] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:57:11 user nova-compute[73450]: INFO nova.compute.claims [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Claim successful on node user
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Starting finish_migration {{(pid=73450) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 16:57:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Creating image(s)
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Ensure instance console log exists: /opt/stack/data/nova/instances/5df06efe-b1d6-470e-a230-bf63734642f5/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Start _get_guest_xml network_info=[{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'b639f888-ea39-4b03-9413-dfb41ce4c550', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5df06efe-b1d6-470e-a230-bf63734642f5', 'attached_at': '2023-08-16T16:57:11.000000', 'detached_at': '', 'volume_id': '79994e09-5f3c-465f-a16c-0c798b6b01b2', 'serial': '79994e09-5f3c-465f-a16c-0c798b6b01b2'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:57:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.objects.instance [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:57:11 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:57:11 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:57:11 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45059b-72e8-4ce0-b518-ae61c4b4b9fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:57:11 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[267ce26e-c502-4e96-a661-db8716a2453c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2] added
Aug 16 16:57:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[34400c46-5e76-4284-b222-7bf88bd69f0e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[406a5fec-25f4-4581-84af-54ec5b51546c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFpzDWPK {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFpzDWPK" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a75ad0-6810-4612-923d-b990ceae79e7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFpzDWPK'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3b3e0-7188-473f-959f-479ca4768d43]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec9b8c-d039-4f31-b91b-59ba917cc7d8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a0694-35b8-41f6-a95e-458d316dfff6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]
Aug 16 16:57:11 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.
Aug 16 16:57:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb2fcd-1f5f-45bb-a775-b1b2d7b1b556]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811308e-cfff-4f74-baa9-205dd305ed66]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:11 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:11 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:11 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.policy [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba47a29f14cc441e826c9af67f20c96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1acac15e03f4d6188cb3517a7901da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb909e18-0669-4e46-937d-c57e1e8335b8]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:57:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Creating image(s)
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "/opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "/opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "/opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk 1073741824" returned: 0 in 0.050s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Successfully created port: 91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Cannot resize image /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'migration_context' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Ensure instance console log exists: /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23364663063383966', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364663063383966', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1646450735',display_name='tempest-ServerActionsTestOtherA-server-1646450735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1646450735',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-60302x42',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=5df06efe-b1d6-470e-a230-bf63734642f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:57:12 user nova-compute[73450]:   <uuid>5df06efe-b1d6-470e-a230-bf63734642f5</uuid>
Aug 16 16:57:12 user nova-compute[73450]:   <name>instance-00000023</name>
Aug 16 16:57:12 user nova-compute[73450]:   <memory>2097152</memory>
Aug 16 16:57:12 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:57:12 user nova-compute[73450]:   <metadata>
Aug 16 16:57:12 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:57:12 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:57:12 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherA-server-1646450735</nova:name>
Aug 16 16:57:12 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:57:11</nova:creationTime>
Aug 16 16:57:12 user nova-compute[73450]:       <nova:flavor name="m1.small">
Aug 16 16:57:12 user nova-compute[73450]:         <nova:memory>2048</nova:memory>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:disk>20</nova:disk>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:57:12 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:57:12 user nova-compute[73450]:       <nova:owner>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:user uuid="cfb44f7411ad47b18d2c58a1dc6ac074">tempest-ServerActionsTestOtherA-1309270761-project-member</nova:user>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:project uuid="db72f2fe40fe410098164a19683782d4">tempest-ServerActionsTestOtherA-1309270761</nova:project>
Aug 16 16:57:12 user nova-compute[73450]:       </nova:owner>
Aug 16 16:57:12 user nova-compute[73450]:       <nova:ports>
Aug 16 16:57:12 user nova-compute[73450]:         <nova:port uuid="c5752bbb-fe02-446e-a096-3d0388da13be">
Aug 16 16:57:12 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 16:57:12 user nova-compute[73450]:         </nova:port>
Aug 16 16:57:12 user nova-compute[73450]:       </nova:ports>
Aug 16 16:57:12 user nova-compute[73450]:     </nova:instance>
Aug 16 16:57:12 user nova-compute[73450]:   </metadata>
Aug 16 16:57:12 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:57:12 user nova-compute[73450]:     <system>
Aug 16 16:57:12 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:57:12 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:57:12 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:57:12 user nova-compute[73450]:       <entry name="serial">5df06efe-b1d6-470e-a230-bf63734642f5</entry>
Aug 16 16:57:12 user nova-compute[73450]:       <entry name="uuid">5df06efe-b1d6-470e-a230-bf63734642f5</entry>
Aug 16 16:57:12 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:57:12 user nova-compute[73450]:     </system>
Aug 16 16:57:12 user nova-compute[73450]:   </sysinfo>
Aug 16 16:57:12 user nova-compute[73450]:   <os>
Aug 16 16:57:12 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:57:12 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:57:12 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:57:12 user nova-compute[73450]:   </os>
Aug 16 16:57:12 user nova-compute[73450]:   <features>
Aug 16 16:57:12 user nova-compute[73450]:     <acpi/>
Aug 16 16:57:12 user nova-compute[73450]:     <apic/>
Aug 16 16:57:12 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:57:12 user nova-compute[73450]:   </features>
Aug 16 16:57:12 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:57:12 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:57:12 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:57:12 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:57:12 user nova-compute[73450]:   </clock>
Aug 16 16:57:12 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:57:12 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:57:12 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:57:12 user nova-compute[73450]:   </cpu>
Aug 16 16:57:12 user nova-compute[73450]:   <devices>
Aug 16 16:57:12 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:57:12 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:57:12 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 16:57:12 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:57:12 user nova-compute[73450]:       <serial>79994e09-5f3c-465f-a16c-0c798b6b01b2</serial>
Aug 16 16:57:12 user nova-compute[73450]:     </disk>
Aug 16 16:57:12 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:57:12 user nova-compute[73450]:       <mac address="fa:16:3e:52:80:be"/>
Aug 16 16:57:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:12 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:57:12 user nova-compute[73450]:       <target dev="tapc5752bbb-fe"/>
Aug 16 16:57:12 user nova-compute[73450]:     </interface>
Aug 16 16:57:12 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:57:12 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/5df06efe-b1d6-470e-a230-bf63734642f5/console.log" append="off"/>
Aug 16 16:57:12 user nova-compute[73450]:     </serial>
Aug 16 16:57:12 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:57:12 user nova-compute[73450]:     <video>
Aug 16 16:57:12 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:12 user nova-compute[73450]:     </video>
Aug 16 16:57:12 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:57:12 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:57:12 user nova-compute[73450]:     </rng>
Aug 16 16:57:12 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:57:12 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:57:12 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:57:12 user nova-compute[73450]:     </memballoon>
Aug 16 16:57:12 user nova-compute[73450]:   </devices>
Aug 16 16:57:12 user nova-compute[73450]: </domain>
Aug 16 16:57:12 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1646450735',display_name='tempest-ServerActionsTestOtherA-server-1646450735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1646450735',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-60302x42',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=5df06efe-b1d6-470e-a230-bf63734642f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-252477887-network", "vif_mac": "fa:16:3e:52:80:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG os_vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205017.7372324, 5df06efe-b1d6-470e-a230-bf63734642f5 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:12 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] VM Stopped (Lifecycle Event)
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5752bbb-fe, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5752bbb-fe, col_values=(('external_ids', {'iface-id': 'c5752bbb-fe02-446e-a096-3d0388da13be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:80:be', 'vm-uuid': '5df06efe-b1d6-470e-a230-bf63734642f5'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:12 user nova-compute[73450]: INFO os_vif [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe')
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-10efba13-30d5-4b41-ad09-258fb227d65a None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-10efba13-30d5-4b41-ad09-258fb227d65a None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:12 user nova-compute[73450]: INFO nova.compute.manager [None req-10efba13-30d5-4b41-ad09-258fb227d65a None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:57:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] No VIF found with MAC fa:16:3e:52:80:be, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Successfully updated port: 91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquired lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-changed-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Refreshing instance network info cache due to event network-changed-91b8fd3d-c79f-4518-b78a-0da24cad6653. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] Acquiring lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating instance_info_cache with network_info: [{"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Releasing lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Instance network_info: |[{"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] Acquired lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Refreshing network info cache for port 91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Start _get_guest_xml network_info=[{"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:57:13 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:13 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1334898268',display_name='tempest-AttachVolumeTestJSON-server-1334898268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1334898268',id=37,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm+ldZwP18dBBanbGPTCxDmNOjOYTyerXJAbmlHQx5eFBk5adWROoVxPBDKuoJZwgUatGE7ibUKAjGcX7nrD4ebqBJU2lueW2wk2WLWz/Znn/NqTNz8sOFsXTkOAtgZnA==',key_name='tempest-keypair-915964222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-14vkts2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=1abb65ae-ec46-4759-8da9-a60ef495c2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'pci_devices' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:57:13 user nova-compute[73450]:   <uuid>1abb65ae-ec46-4759-8da9-a60ef495c2f2</uuid>
Aug 16 16:57:13 user nova-compute[73450]:   <name>instance-00000025</name>
Aug 16 16:57:13 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:57:13 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:57:13 user nova-compute[73450]:   <metadata>
Aug 16 16:57:13 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:57:13 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:57:13 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeTestJSON-server-1334898268</nova:name>
Aug 16 16:57:13 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:57:13</nova:creationTime>
Aug 16 16:57:13 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:57:13 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:57:13 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:57:13 user nova-compute[73450]:       <nova:owner>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:user uuid="ba47a29f14cc441e826c9af67f20c96a">tempest-AttachVolumeTestJSON-570659826-project-member</nova:user>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:project uuid="d1acac15e03f4d6188cb3517a7901da4">tempest-AttachVolumeTestJSON-570659826</nova:project>
Aug 16 16:57:13 user nova-compute[73450]:       </nova:owner>
Aug 16 16:57:13 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 16:57:13 user nova-compute[73450]:       <nova:ports>
Aug 16 16:57:13 user nova-compute[73450]:         <nova:port uuid="91b8fd3d-c79f-4518-b78a-0da24cad6653">
Aug 16 16:57:13 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 16:57:13 user nova-compute[73450]:         </nova:port>
Aug 16 16:57:13 user nova-compute[73450]:       </nova:ports>
Aug 16 16:57:13 user nova-compute[73450]:     </nova:instance>
Aug 16 16:57:13 user nova-compute[73450]:   </metadata>
Aug 16 16:57:13 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:57:13 user nova-compute[73450]:     <system>
Aug 16 16:57:13 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:57:13 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:57:13 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:57:13 user nova-compute[73450]:       <entry name="serial">1abb65ae-ec46-4759-8da9-a60ef495c2f2</entry>
Aug 16 16:57:13 user nova-compute[73450]:       <entry name="uuid">1abb65ae-ec46-4759-8da9-a60ef495c2f2</entry>
Aug 16 16:57:13 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:57:13 user nova-compute[73450]:     </system>
Aug 16 16:57:13 user nova-compute[73450]:   </sysinfo>
Aug 16 16:57:13 user nova-compute[73450]:   <os>
Aug 16 16:57:13 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:57:13 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:57:13 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:57:13 user nova-compute[73450]:   </os>
Aug 16 16:57:13 user nova-compute[73450]:   <features>
Aug 16 16:57:13 user nova-compute[73450]:     <acpi/>
Aug 16 16:57:13 user nova-compute[73450]:     <apic/>
Aug 16 16:57:13 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:57:13 user nova-compute[73450]:   </features>
Aug 16 16:57:13 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:57:13 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:57:13 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:57:13 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:57:13 user nova-compute[73450]:   </clock>
Aug 16 16:57:13 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:57:13 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:57:13 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:57:13 user nova-compute[73450]:   </cpu>
Aug 16 16:57:13 user nova-compute[73450]:   <devices>
Aug 16 16:57:13 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:57:13 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:57:13 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk"/>
Aug 16 16:57:13 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:57:13 user nova-compute[73450]:     </disk>
Aug 16 16:57:13 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:57:13 user nova-compute[73450]:       <mac address="fa:16:3e:ef:b9:4a"/>
Aug 16 16:57:13 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:13 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:57:13 user nova-compute[73450]:       <target dev="tap91b8fd3d-c7"/>
Aug 16 16:57:13 user nova-compute[73450]:     </interface>
Aug 16 16:57:13 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:57:13 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/console.log" append="off"/>
Aug 16 16:57:13 user nova-compute[73450]:     </serial>
Aug 16 16:57:13 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:57:13 user nova-compute[73450]:     <video>
Aug 16 16:57:13 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:13 user nova-compute[73450]:     </video>
Aug 16 16:57:13 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:57:13 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:57:13 user nova-compute[73450]:     </rng>
Aug 16 16:57:13 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:57:13 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:57:13 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:57:13 user nova-compute[73450]:     </memballoon>
Aug 16 16:57:13 user nova-compute[73450]:   </devices>
Aug 16 16:57:13 user nova-compute[73450]: </domain>
Aug 16 16:57:13 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1334898268',display_name='tempest-AttachVolumeTestJSON-server-1334898268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1334898268',id=37,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm+ldZwP18dBBanbGPTCxDmNOjOYTyerXJAbmlHQx5eFBk5adWROoVxPBDKuoJZwgUatGE7ibUKAjGcX7nrD4ebqBJU2lueW2wk2WLWz/Znn/NqTNz8sOFsXTkOAtgZnA==',key_name='tempest-keypair-915964222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-14vkts2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=1abb65ae-ec46-4759-8da9-a60ef495c2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG os_vif [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91b8fd3d-c7, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91b8fd3d-c7, col_values=(('external_ids', {'iface-id': '91b8fd3d-c79f-4518-b78a-0da24cad6653', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:b9:4a', 'vm-uuid': '1abb65ae-ec46-4759-8da9-a60ef495c2f2'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:13 user nova-compute[73450]: INFO os_vif [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7')
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No VIF found with MAC fa:16:3e:ef:b9:4a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updated VIF entry in instance network info cache for port 91b8fd3d-c79f-4518-b78a-0da24cad6653. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG nova.network.neutron [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating instance_info_cache with network_info: [{"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b1bc2fed-c6e5-4888-965b-53edfdb5231d req-3f5f0ae0-0512-40f2-9a76-f2577861005f service nova] Releasing lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-0988ecb7-4366-4aa6-98f8-8edefd2065a9 req-7caa65e7-777c-433e-bc08-89521390460e service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0988ecb7-4366-4aa6-98f8-8edefd2065a9 req-7caa65e7-777c-433e-bc08-89521390460e service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0988ecb7-4366-4aa6-98f8-8edefd2065a9 req-7caa65e7-777c-433e-bc08-89521390460e service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0988ecb7-4366-4aa6-98f8-8edefd2065a9 req-7caa65e7-777c-433e-bc08-89521390460e service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-0988ecb7-4366-4aa6-98f8-8edefd2065a9 req-7caa65e7-777c-433e-bc08-89521390460e service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:14 user nova-compute[73450]: WARNING nova.compute.manager [req-0988ecb7-4366-4aa6-98f8-8edefd2065a9 req-7caa65e7-777c-433e-bc08-89521390460e service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state active and task_state resize_finish.
Aug 16 16:57:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-0fdc8d8d-4dd6-4b94-af50-982ee7fc395d req-00bbe8d8-1827-452d-a65d-57632dfe9691 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0fdc8d8d-4dd6-4b94-af50-982ee7fc395d req-00bbe8d8-1827-452d-a65d-57632dfe9691 service nova] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0fdc8d8d-4dd6-4b94-af50-982ee7fc395d req-00bbe8d8-1827-452d-a65d-57632dfe9691 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0fdc8d8d-4dd6-4b94-af50-982ee7fc395d req-00bbe8d8-1827-452d-a65d-57632dfe9691 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-0fdc8d8d-4dd6-4b94-af50-982ee7fc395d req-00bbe8d8-1827-452d-a65d-57632dfe9691 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] No waiting events found dispatching network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:16 user nova-compute[73450]: WARNING nova.compute.manager [req-0fdc8d8d-4dd6-4b94-af50-982ee7fc395d req-00bbe8d8-1827-452d-a65d-57632dfe9691 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received unexpected event network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 for instance with vm_state building and task_state spawning.
Aug 16 16:57:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-4c31ab1b-a13a-4216-af56-18887cd239c7 req-e65a508a-d646-49f3-964a-30d160000d0e service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4c31ab1b-a13a-4216-af56-18887cd239c7 req-e65a508a-d646-49f3-964a-30d160000d0e service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4c31ab1b-a13a-4216-af56-18887cd239c7 req-e65a508a-d646-49f3-964a-30d160000d0e service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4c31ab1b-a13a-4216-af56-18887cd239c7 req-e65a508a-d646-49f3-964a-30d160000d0e service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:16 user nova-compute[73450]: DEBUG nova.compute.manager [req-4c31ab1b-a13a-4216-af56-18887cd239c7 req-e65a508a-d646-49f3-964a-30d160000d0e service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:16 user nova-compute[73450]: WARNING nova.compute.manager [req-4c31ab1b-a13a-4216-af56-18887cd239c7 req-e65a508a-d646-49f3-964a-30d160000d0e service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state active and task_state resize_finish.
Aug 16 16:57:17 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205037.951545, 5df06efe-b1d6-470e-a230-bf63734642f5 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:17 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] VM Resumed (Lifecycle Event)
Aug 16 16:57:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:57:17 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance running successfully.
Aug 16 16:57:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Failed to set time: agent not configured {{(pid=73450) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 16:57:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-49b8ade8-d146-4d4b-b58c-bc7a14d3e0a3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] finish_migration finished successfully. {{(pid=73450) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 16:57:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205037.9525828, 5df06efe-b1d6-470e-a230-bf63734642f5 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] VM Started (Lifecycle Event)
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205038.0679715, 1abb65ae-ec46-4759-8da9-a60ef495c2f2 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] VM Resumed (Lifecycle Event)
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Instance spawned successfully.
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205038.0685866, 1abb65ae-ec46-4759-8da9-a60ef495c2f2 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] VM Started (Lifecycle Event)
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-89ca0e08-530b-4325-aeb8-469b7edc633e req-397b743f-3a7e-4ca8-a46c-5f0aaa7f8ec5 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-89ca0e08-530b-4325-aeb8-469b7edc633e req-397b743f-3a7e-4ca8-a46c-5f0aaa7f8ec5 service nova] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-89ca0e08-530b-4325-aeb8-469b7edc633e req-397b743f-3a7e-4ca8-a46c-5f0aaa7f8ec5 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-89ca0e08-530b-4325-aeb8-469b7edc633e req-397b743f-3a7e-4ca8-a46c-5f0aaa7f8ec5 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-89ca0e08-530b-4325-aeb8-469b7edc633e req-397b743f-3a7e-4ca8-a46c-5f0aaa7f8ec5 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] No waiting events found dispatching network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:18 user nova-compute[73450]: WARNING nova.compute.manager [req-89ca0e08-530b-4325-aeb8-469b7edc633e req-397b743f-3a7e-4ca8-a46c-5f0aaa7f8ec5 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received unexpected event network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 for instance with vm_state building and task_state spawning.
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 16 16:57:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:18 user nova-compute[73450]: INFO nova.compute.manager [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Took 7.42 seconds to build instance.
Aug 16 16:57:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b084b732-8cf1-42f2-bdf9-c173901ad0b8 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.512s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:57:30 user nova-compute[73450]: INFO nova.compute.claims [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Claim successful on node user
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.network.neutron [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:57:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:57:30 user nova-compute[73450]: INFO nova.virt.block_device [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Booting with volume f7b3212d-3717-4356-bc68-29ec6e56effc at /dev/vda
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.policy [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c95d246b43b45b4963f9d750ae89fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b953d82d634106aa0fb9574fafdc0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG os_brick.utils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc06f054-e1f1-4703-a7cb-5faf5cde26a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c061aa78-cd74-4cf6-9d32-d06421147c5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4539a-6f9d-4fc3-b941-e3cdbf7da92b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214190b-88cd-49f0-902d-c7909cb69533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:57:30 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:57:30 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c166a259-4530-470b-9ba6-ba39ccff716e]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG os_brick.utils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:57:30 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updating existing volume attachment record: 8b8c29bf-4299-479d-9a6b-a3ce778b8869 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:57:31 user nova-compute[73450]: DEBUG nova.network.neutron [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Successfully created port: 96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Successfully updated port: 96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquired lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-changed-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Refreshing instance network info cache due to event network-changed-96435f26-6d2b-485b-b5c0-1b9886daef40. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] Acquiring lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updating instance_info_cache with network_info: [{"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Releasing lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Instance network_info: |[{"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] Acquired lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:32 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Refreshing network info cache for port 96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:57:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updated VIF entry in instance network info cache for port 96435f26-6d2b-485b-b5c0-1b9886daef40. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:57:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updating instance_info_cache with network_info: [{"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3b0f4bab-4a68-42a0-9111-7ba114e41abf req-a295150f-23a9-4d22-8817-d2fb877125da service nova] Releasing lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:40 user nova-compute[73450]: INFO nova.compute.manager [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Terminating instance
Aug 16 16:57:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-36685aa0-b419-4bdd-b2e4-48861d8faecb req-e6c4f02b-ce01-4601-9077-8308f0c1a0bf service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36685aa0-b419-4bdd-b2e4-48861d8faecb req-e6c4f02b-ce01-4601-9077-8308f0c1a0bf service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36685aa0-b419-4bdd-b2e4-48861d8faecb req-e6c4f02b-ce01-4601-9077-8308f0c1a0bf service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36685aa0-b419-4bdd-b2e4-48861d8faecb req-e6c4f02b-ce01-4601-9077-8308f0c1a0bf service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-36685aa0-b419-4bdd-b2e4-48861d8faecb req-e6c4f02b-ce01-4601-9077-8308f0c1a0bf service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-36685aa0-b419-4bdd-b2e4-48861d8faecb req-e6c4f02b-ce01-4601-9077-8308f0c1a0bf service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-unplugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Instance destroyed successfully.
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'resources' on Instance uuid a36f0a56-ed4a-4593-8c78-f71a53938fec {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-647448038',display_name='tempest-ServerRescueNegativeTestJSON-server-647448038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-647448038',id=28,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2lPh+HhM95TmGjXtvq4sutCHienP7AN5IgBpAy70Fwg/Whw0zVT1E7Tvo4JJvJKWkP5YREamZypxNg6rziWDDI5tJYQsQ75h3ZvKL2TXkkkA7726wwup2qEHkGy+SAYQ==',key_name='tempest-keypair-1753196274',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-bx0iht3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d604d793314808984e92afdc5f5da0',uuid=a36f0a56-ed4a-4593-8c78-f71a53938fec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "ceda7838-2709-4eec-be04-e29e1127982b", "address": "fa:16:3e:05:57:b1", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda7838-27", "ovs_interfaceid": "ceda7838-2709-4eec-be04-e29e1127982b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_vif [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceda7838-27, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:41 user nova-compute[73450]: INFO os_vif [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:57:b1,bridge_name='br-int',has_traffic_filtering=True,id=ceda7838-2709-4eec-be04-e29e1127982b,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda7838-27')
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Deleting instance files /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec_del
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Deletion of /opt/stack/data/nova/instances/a36f0a56-ed4a-4593-8c78-f71a53938fec_del complete
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.compute.manager [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.compute.claims [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Claim successful on node user
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Creating image(s)
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Ensure instance console log exists: /opt/stack/data/nova/instances/7b9ea34e-9305-4f7f-ae47-772f70a82dee/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Start _get_guest_xml network_info=[{"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8b8c29bf-4299-479d-9a6b-a3ce778b8869', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b9ea34e-9305-4f7f-ae47-772f70a82dee', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7b3212d-3717-4356-bc68-29ec6e56effc', 'serial': 'f7b3212d-3717-4356-bc68-29ec6e56effc'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:57:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:41 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:57:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:57:41 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:57:41 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[325828ea-6b48-44dc-ba32-70425eac0d33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:57:41 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9ebb94-8e73-42f4-882c-752363f58a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc] added
Aug 16 16:57:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f463e-3f10-4afb-b84f-8da30aaf9296]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfddc04-3885-4d7c-9787-9dc1018987ec]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrNaovBZ {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrNaovBZ" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a23e4-cc78-4af9-9bb7-e77280c14408]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrNaovBZ'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d84c910-40ca-4e73-9f32-cbed06778380]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b08d57-56b9-4eb7-ac4b-008ee5e5e2f8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:41 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:41 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7dead5-3157-4c1e-a86f-c40e07a5ae6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]
Aug 16 16:57:41 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.
Aug 16 16:57:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfda513-5fbe-4552-a2e7-3a38427fcb72]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1416e8-999d-4d20-b004-559d67b7561c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:41 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:41 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:57:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:41 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:41 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:57:41 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d63144e-e426-4e78-896a-86268e1a0b3e]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:57:41 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:41 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Took 0.83 seconds to deallocate network for instance.
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:57:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.policy [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5076f53f390e4fc4b69fe0aa206a916c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee3a81531b34430b14fad85fe6c400c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:57:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Creating image(s)
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "/opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "/opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "/opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "d110de1d21ca6ce7d7ea21b9442c720245326600" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "d110de1d21ca6ce7d7ea21b9442c720245326600" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] Acquiring lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] No waiting events found dispatching network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:42 user nova-compute[73450]: WARNING nova.compute.manager [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received unexpected event network-vif-plugged-ceda7838-2709-4eec-be04-e29e1127982b for instance with vm_state deleted and task_state None.
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-a5553dce-b5f6-49c0-97dd-72cf371d374b req-5366d6de-5456-49b7-96e0-4a5902f48e76 service nova] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Received event network-vif-deleted-ceda7838-2709-4eec-be04-e29e1127982b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23261313438643937', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261313438643937', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:42 user nova-compute[73450]: DEBUG nova.virt.images [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] 0c75fb85-1689-4170-b511-766ce68710d0 was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.part /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:43 user nova-compute[73450]: INFO nova.compute.manager [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Terminating instance
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Successfully created port: 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-169056728',display_name='tempest-TestVolumeBootPattern-server-169056728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-169056728',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-pk71mqtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:57:31Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=7b9ea34e-9305-4f7f-ae47-772f70a82dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b9ea34e-9305-4f7f-ae47-772f70a82dee {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:57:43 user nova-compute[73450]:   <uuid>7b9ea34e-9305-4f7f-ae47-772f70a82dee</uuid>
Aug 16 16:57:43 user nova-compute[73450]:   <name>instance-00000026</name>
Aug 16 16:57:43 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:57:43 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:57:43 user nova-compute[73450]:   <metadata>
Aug 16 16:57:43 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:57:43 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:57:43 user nova-compute[73450]:       <nova:name>tempest-TestVolumeBootPattern-server-169056728</nova:name>
Aug 16 16:57:43 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:57:41</nova:creationTime>
Aug 16 16:57:43 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:57:43 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:57:43 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:57:43 user nova-compute[73450]:       <nova:owner>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:user uuid="8c95d246b43b45b4963f9d750ae89fbd">tempest-TestVolumeBootPattern-717711848-project-member</nova:user>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:project uuid="a3b953d82d634106aa0fb9574fafdc0d">tempest-TestVolumeBootPattern-717711848</nova:project>
Aug 16 16:57:43 user nova-compute[73450]:       </nova:owner>
Aug 16 16:57:43 user nova-compute[73450]:       <nova:ports>
Aug 16 16:57:43 user nova-compute[73450]:         <nova:port uuid="96435f26-6d2b-485b-b5c0-1b9886daef40">
Aug 16 16:57:43 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 16:57:43 user nova-compute[73450]:         </nova:port>
Aug 16 16:57:43 user nova-compute[73450]:       </nova:ports>
Aug 16 16:57:43 user nova-compute[73450]:     </nova:instance>
Aug 16 16:57:43 user nova-compute[73450]:   </metadata>
Aug 16 16:57:43 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:57:43 user nova-compute[73450]:     <system>
Aug 16 16:57:43 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:57:43 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:57:43 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:57:43 user nova-compute[73450]:       <entry name="serial">7b9ea34e-9305-4f7f-ae47-772f70a82dee</entry>
Aug 16 16:57:43 user nova-compute[73450]:       <entry name="uuid">7b9ea34e-9305-4f7f-ae47-772f70a82dee</entry>
Aug 16 16:57:43 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:57:43 user nova-compute[73450]:     </system>
Aug 16 16:57:43 user nova-compute[73450]:   </sysinfo>
Aug 16 16:57:43 user nova-compute[73450]:   <os>
Aug 16 16:57:43 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:57:43 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:57:43 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:57:43 user nova-compute[73450]:   </os>
Aug 16 16:57:43 user nova-compute[73450]:   <features>
Aug 16 16:57:43 user nova-compute[73450]:     <acpi/>
Aug 16 16:57:43 user nova-compute[73450]:     <apic/>
Aug 16 16:57:43 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:57:43 user nova-compute[73450]:   </features>
Aug 16 16:57:43 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:57:43 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:57:43 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:57:43 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:57:43 user nova-compute[73450]:   </clock>
Aug 16 16:57:43 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:57:43 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:57:43 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:57:43 user nova-compute[73450]:   </cpu>
Aug 16 16:57:43 user nova-compute[73450]:   <devices>
Aug 16 16:57:43 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 16:57:43 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:57:43 user nova-compute[73450]:       <source dev="/dev/sdc"/>
Aug 16 16:57:43 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:57:43 user nova-compute[73450]:       <serial>f7b3212d-3717-4356-bc68-29ec6e56effc</serial>
Aug 16 16:57:43 user nova-compute[73450]:     </disk>
Aug 16 16:57:43 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:57:43 user nova-compute[73450]:       <mac address="fa:16:3e:24:a0:f1"/>
Aug 16 16:57:43 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:43 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:57:43 user nova-compute[73450]:       <target dev="tap96435f26-6d"/>
Aug 16 16:57:43 user nova-compute[73450]:     </interface>
Aug 16 16:57:43 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:57:43 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/7b9ea34e-9305-4f7f-ae47-772f70a82dee/console.log" append="off"/>
Aug 16 16:57:43 user nova-compute[73450]:     </serial>
Aug 16 16:57:43 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:57:43 user nova-compute[73450]:     <video>
Aug 16 16:57:43 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:43 user nova-compute[73450]:     </video>
Aug 16 16:57:43 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:57:43 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:57:43 user nova-compute[73450]:     </rng>
Aug 16 16:57:43 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:57:43 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:57:43 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:57:43 user nova-compute[73450]:     </memballoon>
Aug 16 16:57:43 user nova-compute[73450]:   </devices>
Aug 16 16:57:43 user nova-compute[73450]: </domain>
Aug 16 16:57:43 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-169056728',display_name='tempest-TestVolumeBootPattern-server-169056728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-169056728',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-pk71mqtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:57:31Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=7b9ea34e-9305-4f7f-ae47-772f70a82dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG os_vif [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96435f26-6d, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96435f26-6d, col_values=(('external_ids', {'iface-id': '96435f26-6d2b-485b-b5c0-1b9886daef40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:a0:f1', 'vm-uuid': '7b9ea34e-9305-4f7f-ae47-772f70a82dee'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: INFO os_vif [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d')
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:43 user nova-compute[73450]: INFO nova.compute.manager [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Terminating instance
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.part /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.converted" returned: 0 in 0.429s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.488s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No VIF found with MAC fa:16:3e:24:a0:f1, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:57:43 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Deleted allocations for instance a36f0a56-ed4a-4593-8c78-f71a53938fec
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "d110de1d21ca6ce7d7ea21b9442c720245326600" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.485s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-fb25a1b7-2a41-4fc8-b43d-5c6f286883c3 req-584c95f4-47a9-480d-9198-4775f4e59706 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-vif-unplugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fb25a1b7-2a41-4fc8-b43d-5c6f286883c3 req-584c95f4-47a9-480d-9198-4775f4e59706 service nova] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fb25a1b7-2a41-4fc8-b43d-5c6f286883c3 req-584c95f4-47a9-480d-9198-4775f4e59706 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fb25a1b7-2a41-4fc8-b43d-5c6f286883c3 req-584c95f4-47a9-480d-9198-4775f4e59706 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-fb25a1b7-2a41-4fc8-b43d-5c6f286883c3 req-584c95f4-47a9-480d-9198-4775f4e59706 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] No waiting events found dispatching network-vif-unplugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-fb25a1b7-2a41-4fc8-b43d-5c6f286883c3 req-584c95f4-47a9-480d-9198-4775f4e59706 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-vif-unplugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2f8f5bee-3cb9-4aa8-9404-ab4ccd33be7b tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "a36f0a56-ed4a-4593-8c78-f71a53938fec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.527s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "d110de1d21ca6ce7d7ea21b9442c720245326600" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "d110de1d21ca6ce7d7ea21b9442c720245326600" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600,backing_fmt=raw /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600,backing_fmt=raw /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk 1073741824" returned: 0 in 0.049s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "d110de1d21ca6ce7d7ea21b9442c720245326600" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Cannot resize image /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'migration_context' on Instance uuid 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Ensure instance console log exists: /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Instance destroyed successfully.
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'resources' on Instance uuid 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163959128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163959128',id=26,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:48:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-k0neywtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:50:16Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "address": "fa:16:3e:ff:f5:7e", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c191e63-c7", "ovs_interfaceid": "8c191e63-c777-4bbd-b590-2f5d90d33dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG os_vif [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c191e63-c7, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: INFO os_vif [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f5:7e,bridge_name='br-int',has_traffic_filtering=True,id=8c191e63-c777-4bbd-b590-2f5d90d33dc7,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c191e63-c7')
Aug 16 16:57:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Deleting instance files /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4_del
Aug 16 16:57:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Deletion of /opt/stack/data/nova/instances/1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4_del complete
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-21a8e72a-6d6c-4c53-b7fc-64729ec44c31 req-a4ceefc3-9411-410e-84d8-db1e9ecf7d42 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-vif-unplugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-21a8e72a-6d6c-4c53-b7fc-64729ec44c31 req-a4ceefc3-9411-410e-84d8-db1e9ecf7d42 service nova] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-21a8e72a-6d6c-4c53-b7fc-64729ec44c31 req-a4ceefc3-9411-410e-84d8-db1e9ecf7d42 service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-21a8e72a-6d6c-4c53-b7fc-64729ec44c31 req-a4ceefc3-9411-410e-84d8-db1e9ecf7d42 service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-21a8e72a-6d6c-4c53-b7fc-64729ec44c31 req-a4ceefc3-9411-410e-84d8-db1e9ecf7d42 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] No waiting events found dispatching network-vif-unplugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-21a8e72a-6d6c-4c53-b7fc-64729ec44c31 req-a4ceefc3-9411-410e-84d8-db1e9ecf7d42 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-vif-unplugged-15a4b383-d9ed-4548-a49d-a509a177e33c for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: INFO nova.compute.manager [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Took 1.77 seconds to destroy the instance on the hypervisor.
Aug 16 16:57:44 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-changed-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Refreshing instance network info cache due to event network-changed-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] Acquiring lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] Acquired lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Refreshing network info cache for port 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:57:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Instance destroyed successfully.
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lazy-loading 'resources' on Instance uuid f0740cc8-0435-43d3-8e8d-c0b05240947e {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1027793632',display_name='tempest-TestServerVolumeAttachmentScenario-server-1027793632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1027793632',id=33,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFx6JYupBcCGkDepX7s644n5ZGdokBugjXd++Cv4v/rmXH0dLf0MRR3ezsl4iM/A+ZBrrbBQDEvtABvrYzAGdrLxN6a62It/ZN0qo7l9e6p1oMegEUGhNjBEpKcQDN/A==',key_name='tempest-keypair-1716247603',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:53:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39f7ffafeb9540018858b70f436caf82',ramdisk_id='',reservation_id='r-oeo8gks0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-599690406',owner_user_name='tempest-TestServerVolumeAttachmentScenario-599690406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ad6596f3b24060afcb46a826b225dd',uuid=f0740cc8-0435-43d3-8e8d-c0b05240947e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Converting VIF {"id": "15a4b383-d9ed-4548-a49d-a509a177e33c", "address": "fa:16:3e:1e:e1:66", "network": {"id": "060d2f87-da43-4e20-89c3-df08e29b0ab2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-990688922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f7ffafeb9540018858b70f436caf82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a4b383-d9", "ovs_interfaceid": "15a4b383-d9ed-4548-a49d-a509a177e33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_vif [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15a4b383-d9, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: INFO os_vif [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:e1:66,bridge_name='br-int',has_traffic_filtering=True,id=15a4b383-d9ed-4548-a49d-a509a177e33c,network=Network(060d2f87-da43-4e20-89c3-df08e29b0ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a4b383-d9')
Aug 16 16:57:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Deleting instance files /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e_del
Aug 16 16:57:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Deletion of /opt/stack/data/nova/instances/f0740cc8-0435-43d3-8e8d-c0b05240947e_del complete
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Successfully updated port: 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:57:45 user nova-compute[73450]: INFO nova.compute.manager [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Took 1.75 seconds to destroy the instance on the hypervisor.
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'flavor' on Instance uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance network_info: |[{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Start _get_guest_xml network_info=[{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:57:38Z,direct_url=<?>,disk_format='qcow2',id=0c75fb85-1689-4170-b511-766ce68710d0,min_disk=0,min_ram=0,name='tempest-scenario-img--896302250',owner='4ee3a81531b34430b14fad85fe6c400c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:57:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': '0c75fb85-1689-4170-b511-766ce68710d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:57:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:57:38Z,direct_url=<?>,disk_format='qcow2',id=0c75fb85-1689-4170-b511-766ce68710d0,min_disk=0,min_ram=0,name='tempest-scenario-img--896302250',owner='4ee3a81531b34430b14fad85fe6c400c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:57:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1010143228',display_name='tempest-TestMinimumBasicScenario-server-1010143228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1010143228',id=39,image_ref='0c75fb85-1689-4170-b511-766ce68710d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHfCo0ijcx/bxwlq7h95FsXQ+I3G/ieWSFebImFs141BK4rD0IdXfWBHqhI7SOEG7dexf4iX/d66OW+Op3IFsbpVQHGNF6Itw64uk3YbNY1Cr/RQ2hoDWiXFDm59JpCQQ==',key_name='tempest-TestMinimumBasicScenario-1288503622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-oqteyfb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c75fb85-1689-4170-b511-766ce68710d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:57:42Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=353b264b-48d2-4b1a-b70a-6c9b0aa52b1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'pci_devices' on Instance uuid 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:57:45 user nova-compute[73450]:   <uuid>353b264b-48d2-4b1a-b70a-6c9b0aa52b1a</uuid>
Aug 16 16:57:45 user nova-compute[73450]:   <name>instance-00000027</name>
Aug 16 16:57:45 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:57:45 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:57:45 user nova-compute[73450]:   <metadata>
Aug 16 16:57:45 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:57:45 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:57:45 user nova-compute[73450]:       <nova:name>tempest-TestMinimumBasicScenario-server-1010143228</nova:name>
Aug 16 16:57:45 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:57:45</nova:creationTime>
Aug 16 16:57:45 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:57:45 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:57:45 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:57:45 user nova-compute[73450]:       <nova:owner>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:user uuid="5076f53f390e4fc4b69fe0aa206a916c">tempest-TestMinimumBasicScenario-1533627500-project-member</nova:user>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:project uuid="4ee3a81531b34430b14fad85fe6c400c">tempest-TestMinimumBasicScenario-1533627500</nova:project>
Aug 16 16:57:45 user nova-compute[73450]:       </nova:owner>
Aug 16 16:57:45 user nova-compute[73450]:       <nova:root type="image" uuid="0c75fb85-1689-4170-b511-766ce68710d0"/>
Aug 16 16:57:45 user nova-compute[73450]:       <nova:ports>
Aug 16 16:57:45 user nova-compute[73450]:         <nova:port uuid="045dc6da-e423-458f-b666-25bbb02f3e50">
Aug 16 16:57:45 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 16:57:45 user nova-compute[73450]:         </nova:port>
Aug 16 16:57:45 user nova-compute[73450]:       </nova:ports>
Aug 16 16:57:45 user nova-compute[73450]:     </nova:instance>
Aug 16 16:57:45 user nova-compute[73450]:   </metadata>
Aug 16 16:57:45 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:57:45 user nova-compute[73450]:     <system>
Aug 16 16:57:45 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:57:45 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:57:45 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:57:45 user nova-compute[73450]:       <entry name="serial">353b264b-48d2-4b1a-b70a-6c9b0aa52b1a</entry>
Aug 16 16:57:45 user nova-compute[73450]:       <entry name="uuid">353b264b-48d2-4b1a-b70a-6c9b0aa52b1a</entry>
Aug 16 16:57:45 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:57:45 user nova-compute[73450]:     </system>
Aug 16 16:57:45 user nova-compute[73450]:   </sysinfo>
Aug 16 16:57:45 user nova-compute[73450]:   <os>
Aug 16 16:57:45 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:57:45 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:57:45 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:57:45 user nova-compute[73450]:   </os>
Aug 16 16:57:45 user nova-compute[73450]:   <features>
Aug 16 16:57:45 user nova-compute[73450]:     <acpi/>
Aug 16 16:57:45 user nova-compute[73450]:     <apic/>
Aug 16 16:57:45 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:57:45 user nova-compute[73450]:   </features>
Aug 16 16:57:45 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:57:45 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:57:45 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:57:45 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:57:45 user nova-compute[73450]:   </clock>
Aug 16 16:57:45 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:57:45 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:57:45 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:57:45 user nova-compute[73450]:   </cpu>
Aug 16 16:57:45 user nova-compute[73450]:   <devices>
Aug 16 16:57:45 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:57:45 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:57:45 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk"/>
Aug 16 16:57:45 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:57:45 user nova-compute[73450]:     </disk>
Aug 16 16:57:45 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:57:45 user nova-compute[73450]:       <mac address="fa:16:3e:8b:d7:aa"/>
Aug 16 16:57:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:45 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:57:45 user nova-compute[73450]:       <target dev="tap045dc6da-e4"/>
Aug 16 16:57:45 user nova-compute[73450]:     </interface>
Aug 16 16:57:45 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:57:45 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/console.log" append="off"/>
Aug 16 16:57:45 user nova-compute[73450]:     </serial>
Aug 16 16:57:45 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:57:45 user nova-compute[73450]:     <video>
Aug 16 16:57:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:57:45 user nova-compute[73450]:     </video>
Aug 16 16:57:45 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:57:45 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:57:45 user nova-compute[73450]:     </rng>
Aug 16 16:57:45 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:57:45 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:57:45 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:57:45 user nova-compute[73450]:     </memballoon>
Aug 16 16:57:45 user nova-compute[73450]:   </devices>
Aug 16 16:57:45 user nova-compute[73450]: </domain>
Aug 16 16:57:45 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1010143228',display_name='tempest-TestMinimumBasicScenario-server-1010143228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1010143228',id=39,image_ref='0c75fb85-1689-4170-b511-766ce68710d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHfCo0ijcx/bxwlq7h95FsXQ+I3G/ieWSFebImFs141BK4rD0IdXfWBHqhI7SOEG7dexf4iX/d66OW+Op3IFsbpVQHGNF6Itw64uk3YbNY1Cr/RQ2hoDWiXFDm59JpCQQ==',key_name='tempest-TestMinimumBasicScenario-1288503622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-oqteyfb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c75fb85-1689-4170-b511-766ce68710d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:57:42Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=353b264b-48d2-4b1a-b70a-6c9b0aa52b1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_vif [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap045dc6da-e4, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap045dc6da-e4, col_values=(('external_ids', {'iface-id': '045dc6da-e423-458f-b666-25bbb02f3e50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:d7:aa', 'vm-uuid': '353b264b-48d2-4b1a-b70a-6c9b0aa52b1a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:45 user nova-compute[73450]: INFO nova.compute.manager [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Attaching volume 0af1cbeb-735d-4872-9446-044d0b18313a to /dev/vdb
Aug 16 16:57:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:45 user nova-compute[73450]: INFO os_vif [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4')
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_brick.utils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f9a03a-96a9-4d64-921a-73541cf55e95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No VIF found with MAC fa:16:3e:8b:d7:aa, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-2353653e-0ef6-4682-9b0c-dffe646e68ee req-a58d2ad7-74a1-40ea-b8e1-94aa0e3a1272 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2353653e-0ef6-4682-9b0c-dffe646e68ee req-a58d2ad7-74a1-40ea-b8e1-94aa0e3a1272 service nova] Acquiring lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2353653e-0ef6-4682-9b0c-dffe646e68ee req-a58d2ad7-74a1-40ea-b8e1-94aa0e3a1272 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2353653e-0ef6-4682-9b0c-dffe646e68ee req-a58d2ad7-74a1-40ea-b8e1-94aa0e3a1272 service nova] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-2353653e-0ef6-4682-9b0c-dffe646e68ee req-a58d2ad7-74a1-40ea-b8e1-94aa0e3a1272 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] No waiting events found dispatching network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:45 user nova-compute[73450]: WARNING nova.compute.manager [req-2353653e-0ef6-4682-9b0c-dffe646e68ee req-a58d2ad7-74a1-40ea-b8e1-94aa0e3a1272 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received unexpected event network-vif-plugged-8c191e63-c777-4bbd-b590-2f5d90d33dc7 for instance with vm_state active and task_state deleting.
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422bd89-a640-4b4e-aa26-34b3333772ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee011c-be17-437a-ac51-06bdbfb8c95e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[983b7360-7f51-4444-8649-32ea893a5000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:57:45 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:57:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb544f-e020-4af3-982a-e3f0a9d3e2f2]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG os_brick.utils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:57:45 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating existing volume attachment record: 2161296f-9f4d-4eab-b385-ef8e2633b583 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:57:45 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Took 1.07 seconds to deallocate network for instance.
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:46 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Took 1.37 seconds to deallocate network for instance.
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updated VIF entry in instance network info cache for port 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating instance_info_cache with network_info: [{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8617cb22-f145-4fb9-9e4d-071645794a29 req-e711d61c-a936-4ce4-aa0c-b9056f43fa3b service nova] Releasing lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:46 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Deleted allocations for instance 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9e3995ab-6c39-419f-8a1b-34e03778ebca tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.654s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] Acquiring lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] No waiting events found dispatching network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:46 user nova-compute[73450]: WARNING nova.compute.manager [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received unexpected event network-vif-plugged-15a4b383-d9ed-4548-a49d-a509a177e33c for instance with vm_state deleted and task_state None.
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing instance network info cache due to event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-795949a2-42a1-4584-abc3-d09c43fa5cb1 req-8bd49011-8ec7-4ffd-a3b4-17c3e289b851 service nova] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Received event network-vif-deleted-15a4b383-d9ed-4548-a49d-a509a177e33c {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:47 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Deleted allocations for instance f0740cc8-0435-43d3-8e8d-c0b05240947e
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-78879bae-2e25-483d-82f5-e9290b18665f tempest-TestServerVolumeAttachmentScenario-599690406 tempest-TestServerVolumeAttachmentScenario-599690406-project-member] Lock "f0740cc8-0435-43d3-8e8d-c0b05240947e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.800s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updated VIF entry in instance network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ff0c8daa-29bc-4ab8-95b6-23913e2b9c49 req-1d679f0d-8e40-4e18-8fa2-ccdedaee647c service nova] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Received event network-vif-deleted-8c191e63-c777-4bbd-b590-2f5d90d33dc7 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] No waiting events found dispatching network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:47 user nova-compute[73450]: WARNING nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received unexpected event network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 for instance with vm_state building and task_state spawning.
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] No waiting events found dispatching network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:47 user nova-compute[73450]: WARNING nova.compute.manager [req-264a64f7-b625-4872-9166-b7cdc0cde0ee req-af2ecd2e-ee5f-4db2-bd04-ed0ce04f22c1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received unexpected event network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 for instance with vm_state building and task_state spawning.
Aug 16 16:57:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205068.9492686, 7b9ea34e-9305-4f7f-ae47-772f70a82dee => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] VM Resumed (Lifecycle Event)
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:57:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Instance spawned successfully.
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205068.9502652, 7b9ea34e-9305-4f7f-ae47-772f70a82dee => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] VM Started (Lifecycle Event)
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Took 7.66 seconds to spawn the instance on the hypervisor.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:49 user nova-compute[73450]: WARNING nova.compute.manager [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state building and task_state spawning.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:57:49 user nova-compute[73450]: WARNING nova.compute.manager [req-f200a73d-206d-49a2-bb44-534e9f8cf4aa req-f5817a45-245a-428a-b3ba-64d107c442cc service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state building and task_state spawning.
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Took 19.17 seconds to build instance.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2fdfd073-1c49-4b14-9e79-01296d1c23d5 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.467s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205069.5102665, 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] VM Resumed (Lifecycle Event)
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance spawned successfully.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205069.5120776, 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] VM Started (Lifecycle Event)
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Took 7.41 seconds to spawn the instance on the hypervisor.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:57:49 user nova-compute[73450]: INFO nova.compute.manager [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Took 8.43 seconds to build instance.
Aug 16 16:57:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de281874-5cbe-4799-9dd3-296238188f72 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.532s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:51 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:57:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:57:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:57:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:57:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [{"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:57:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-032b05e3-0db8-4029-9764-9fcce2eb55a7" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:57:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:57:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205061.024055, a36f0a56-ed4a-4593-8c78-f71a53938fec => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:56 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] VM Stopped (Lifecycle Event)
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f1b8951f-fd63-449b-b590-7c231471d50c None None] [instance: a36f0a56-ed4a-4593-8c78-f71a53938fec] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xScpmHGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:57:57 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:57:57 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:57:57 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2f01a2-ba44-4dc5-8758-5c033e9a0e67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:57:57 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad531050-006d-4b18-828c-e318a21c37f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a] added
Aug 16 16:57:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[411c06e0-c9ce-41ef-bb71-42140c92c17f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9cfc3-e8cf-4c3b-882d-6c1aefc7147e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xScpmHGn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xScpmHGn" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bfb3fa-bed2-4b2a-a252-46fa5da7b55b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xScpmHGn'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a4cf99-4703-41ac-aeb5-c7f4e6657808]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31e367f-100d-422b-a648-f963b1b876f1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:57:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:57:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9dd4bf-4108-4e05-adfc-499a6296ef9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260]
Aug 16 16:57:57 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260] successful.
Aug 16 16:57:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e9aeb-5450-4aa8-8956-e7a4856445fc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5506801-f352-4c97-bbfa-8572e15ea1f6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a (non-flash)
Aug 16 16:57:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:57:57 user nova-compute[73450]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a (non-flash)
Aug 16 16:57:57 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada44ae5-eb77-4bdf-b7f7-c1299c6e701c]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:57:57 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xScpmHGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26137623932646635', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137623932646635', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG nova.objects.instance [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'flavor' on Instance uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:57:58 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:57:58 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:57:58 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:57:58 user nova-compute[73450]:   <serial>0af1cbeb-735d-4872-9446-044d0b18313a</serial>
Aug 16 16:57:58 user nova-compute[73450]: </disk>
Aug 16 16:57:58 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No VIF found with MAC fa:16:3e:57:a2:63, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205064.707593, 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:57:59 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] VM Stopped (Lifecycle Event)
Aug 16 16:57:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-c7bd6add-51c9-4f0c-91cf-b14e8e73627a None None] [instance: 1e1a041d-4cab-49e4-8c10-3ce0e46d2ad4] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:59 user nova-compute[73450]: INFO nova.compute.manager [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Terminating instance
Aug 16 16:57:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-15b15069-9ac2-4809-8f34-e22dbcb34f67 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.133s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:57:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205065.0393364, f0740cc8-0435-43d3-8e8d-c0b05240947e => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:58:00 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] VM Stopped (Lifecycle Event)
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-ab0eac88-67cf-43d2-98ad-ae21b23c8cf2 req-e30022f8-9d41-4ad9-b024-7be226238219 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-unplugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ab0eac88-67cf-43d2-98ad-ae21b23c8cf2 req-e30022f8-9d41-4ad9-b024-7be226238219 service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ab0eac88-67cf-43d2-98ad-ae21b23c8cf2 req-e30022f8-9d41-4ad9-b024-7be226238219 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ab0eac88-67cf-43d2-98ad-ae21b23c8cf2 req-e30022f8-9d41-4ad9-b024-7be226238219 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-ab0eac88-67cf-43d2-98ad-ae21b23c8cf2 req-e30022f8-9d41-4ad9-b024-7be226238219 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-unplugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-ab0eac88-67cf-43d2-98ad-ae21b23c8cf2 req-e30022f8-9d41-4ad9-b024-7be226238219 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-unplugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:58:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:58:00 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7272MB free_disk=23.778118133544922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3c9442f0-7ca9-42af-9f36-e643a178d036 None None] [instance: f0740cc8-0435-43d3-8e8d-c0b05240947e] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:58:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Instance destroyed successfully.
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lazy-loading 'resources' on Instance uuid 032b05e3-0db8-4029-9764-9fcce2eb55a7 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T16:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-82395713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-82395713',id=32,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9wx1HqZBFRRzpOrl0b+KPMCa/xZA+meAVheL62++nu24P3x9fkJQdajlP29b1w+b+PSuHYCqa6QjCNhlam1eZXSMj8WjwnDJoCUDhdDPHO/+0ObZwZTrBhHjiiaxc75Q==',key_name='tempest-keypair-2132504027',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6dfde9621b946408c11bcf2465a9a3d',ramdisk_id='',reservation_id='r-r4x0kwml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-405972124',owner_user_name='tempest-AttachVolumeShelveTestJSON-405972124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ed98f68e9e04991817ddf00c2c3cb0e',uuid=032b05e3-0db8-4029-9764-9fcce2eb55a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converting VIF {"id": "6619da50-8624-4c5b-a838-615e36ce5fc6", "address": "fa:16:3e:fd:2e:34", "network": {"id": "c8b51d52-6fe0-4f4c-8dd1-6b3a99073472", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1386473258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6dfde9621b946408c11bcf2465a9a3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619da50-86", "ovs_interfaceid": "6619da50-8624-4c5b-a838-615e36ce5fc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG os_vif [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6619da50-86, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:58:00 user nova-compute[73450]: INFO os_vif [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=6619da50-8624-4c5b-a838-615e36ce5fc6,network=Network(c8b51d52-6fe0-4f4c-8dd1-6b3a99073472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619da50-86')
Aug 16 16:58:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Deleting instance files /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7_del
Aug 16 16:58:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Deletion of /opt/stack/data/nova/instances/032b05e3-0db8-4029-9764-9fcce2eb55a7_del complete
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Applying migration context for instance 5df06efe-b1d6-470e-a230-bf63734642f5 as it has an incoming, in-progress migration aff104b8-8f41-4d1b-831e-579df4f97277. Migration status is finished {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 16:58:00 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating resource usage from migration aff104b8-8f41-4d1b-831e-579df4f97277
Aug 16 16:58:00 user nova-compute[73450]: INFO nova.compute.manager [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 16:58:00 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 78128529-664d-4e24-9a7b-a242e67a2ddf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 032b05e3-0db8-4029-9764-9fcce2eb55a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Migration aff104b8-8f41-4d1b-831e-579df4f97277 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 7b9ea34e-9305-4f7f-ae47-772f70a82dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:58:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:58:01 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Took 1.04 seconds to deallocate network for instance.
Aug 16 16:58:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] Acquiring lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] No waiting events found dispatching network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:58:02 user nova-compute[73450]: WARNING nova.compute.manager [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received unexpected event network-vif-plugged-6619da50-8624-4c5b-a838-615e36ce5fc6 for instance with vm_state deleted and task_state None.
Aug 16 16:58:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-25630b1b-f1a7-4b69-bc79-01513b94759e req-38da39b8-9087-463a-a281-106cfd0f64b5 service nova] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Received event network-vif-deleted-6619da50-8624-4c5b-a838-615e36ce5fc6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:58:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:02 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Deleted allocations for instance 032b05e3-0db8-4029-9764-9fcce2eb55a7
Aug 16 16:58:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8f565193-aa79-4860-9a05-c18ddd6b744f tempest-AttachVolumeShelveTestJSON-405972124 tempest-AttachVolumeShelveTestJSON-405972124-project-member] Lock "032b05e3-0db8-4029-9764-9fcce2eb55a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.777s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:03 user nova-compute[73450]: INFO nova.compute.manager [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Detaching volume 0af1cbeb-735d-4872-9446-044d0b18313a
Aug 16 16:58:03 user nova-compute[73450]: INFO nova.virt.block_device [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Attempting to driver detach volume 0af1cbeb-735d-4872-9446-044d0b18313a from mountpoint /dev/vdb
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Attempting to detach device vdb from instance b1da2b30-72cd-46f8-8620-d8c044e79c96 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:58:03 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:58:03 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:58:03 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:58:03 user nova-compute[73450]:   <serial>0af1cbeb-735d-4872-9446-044d0b18313a</serial>
Aug 16 16:58:03 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:58:03 user nova-compute[73450]: </disk>
Aug 16 16:58:03 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:58:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully detached device vdb from instance b1da2b30-72cd-46f8-8620-d8c044e79c96 from the persistent domain config.
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1da2b30-72cd-46f8-8620-d8c044e79c96 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:58:03 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:58:03 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:58:03 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:58:03 user nova-compute[73450]:   <serial>0af1cbeb-735d-4872-9446-044d0b18313a</serial>
Aug 16 16:58:03 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:58:03 user nova-compute[73450]: </disk>
Aug 16 16:58:03 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205083.977538, b1da2b30-72cd-46f8-8620-d8c044e79c96 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:58:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully detached device vdb from instance b1da2b30-72cd-46f8-8620-d8c044e79c96 from the live domain config.
Aug 16 16:58:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xScpmHGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:58:03 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:58:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:58:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[941b8d17-0877-4737-8559-cc6c6c1bef54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5d2a6-25c5-4dbe-ae9a-02043aa79341]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:58:04 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:58:04 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:58:04 user nova-compute[73450]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a (non-flash)
Aug 16 16:58:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:58:04 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:58:04 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:58:04 user nova-compute[73450]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a (non-flash)
Aug 16 16:58:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270131870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf6149-20f3-4773-9a3e-6667cc4b7eff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec8860-f8be-46df-b91f-013602aefc6a]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4ebd0b-35a3-4484-ba73-3db54bb1b27d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb3cd13-f3aa-46bf-93df-834eed36889c]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35a93ba-adf1-429f-ad72-b3d2ef6e04b8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e88631a-a2a9-438d-9941-da77ed9ac874]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260]
Aug 16 16:58:04 user nova-compute[73450]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a, portal: 172.16.0.220,3260] successful.
Aug 16 16:58:04 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0af1cbeb-735d-4872-9446-044d0b18313a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a57dcf-5e82-4ca0-a204-80a637c8c311]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] <== disconnect_volume: return (287ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:58:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:05 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'flavor' on Instance uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:58:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d54dea79-52b1-4f1e-9c16-d77de0b298ca tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:15 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205080.432202, 032b05e3-0db8-4029-9764-9fcce2eb55a7 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:58:15 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] VM Stopped (Lifecycle Event)
Aug 16 16:58:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f56b5791-2a75-40d3-9a39-d8f2ba0cc8d3 None None] [instance: 032b05e3-0db8-4029-9764-9fcce2eb55a7] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:58:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:58:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:58:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:58:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:58:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:58:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:32 user nova-compute[73450]: INFO nova.compute.manager [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Terminating instance
Aug 16 16:58:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-c64ce3e6-9c03-4ca7-be2d-f06ff29fcd50 req-14b67865-d453-4b88-b8a9-6109b280ac2e service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c64ce3e6-9c03-4ca7-be2d-f06ff29fcd50 req-14b67865-d453-4b88-b8a9-6109b280ac2e service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c64ce3e6-9c03-4ca7-be2d-f06ff29fcd50 req-14b67865-d453-4b88-b8a9-6109b280ac2e service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c64ce3e6-9c03-4ca7-be2d-f06ff29fcd50 req-14b67865-d453-4b88-b8a9-6109b280ac2e service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-c64ce3e6-9c03-4ca7-be2d-f06ff29fcd50 req-14b67865-d453-4b88-b8a9-6109b280ac2e service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-c64ce3e6-9c03-4ca7-be2d-f06ff29fcd50 req-14b67865-d453-4b88-b8a9-6109b280ac2e service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-unplugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:58:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Instance destroyed successfully.
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'resources' on Instance uuid 78128529-664d-4e24-9a7b-a242e67a2ddf {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2033664467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2033664467',id=16,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-d6yxi6ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:46:31Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=78128529-664d-4e24-9a7b-a242e67a2ddf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "address": "fa:16:3e:cc:c6:ee", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7c11f4-7d", "ovs_interfaceid": "6a7c11f4-7da8-438a-847f-31ccfd4eceea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_vif [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a7c11f4-7d, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:33 user nova-compute[73450]: INFO os_vif [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c6:ee,bridge_name='br-int',has_traffic_filtering=True,id=6a7c11f4-7da8-438a-847f-31ccfd4eceea,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7c11f4-7d')
Aug 16 16:58:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywLMnsDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:58:33 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11321d4-50be-4130-925b-6348443e8267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d3b188-da9b-44e1-81a3-885efdebb059]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:58:33 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:58:33 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:58:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa (non-flash)
Aug 16 16:58:33 user nova-compute[73450]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:58:33 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:58:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270130a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa'): ({'sdj'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Removing single pathed devices sdj {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d4663-2bc5-439c-97b9-60d712f52c48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1030c82e-bbfe-4429-8d09-0484565fa922]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Flushing IO for device /dev/sdj {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d1dbad-e295-4bd3-80ac-2bb406168863]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39ed09-308e-4fea-8e99-406455b9e460]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] SCSI volumes sdj have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9dfebc-37d8-49b7-a9ce-073dcd9bc553]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:58:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011f612-7d5a-4f71-aa2d-b4d3f06aac64]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260]
Aug 16 16:58:34 user nova-compute[73450]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa, portal: 172.16.0.220,3260] successful.
Aug 16 16:58:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:578ef01e-d82e-4971-b5a5-623d8ccd30aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe6dc6-8876-4647-b357-d4309039e99c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] <== disconnect_volume: return (283ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:58:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Deleting instance files /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf_del
Aug 16 16:58:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Deletion of /opt/stack/data/nova/instances/78128529-664d-4e24-9a7b-a242e67a2ddf_del complete
Aug 16 16:58:34 user nova-compute[73450]: INFO nova.compute.manager [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 16 16:58:34 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:58:34 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:58:34 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Took 0.63 seconds to deallocate network for instance.
Aug 16 16:58:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-c0ed06da-0530-4e3d-a2b9-49b6f78b2899 req-e0079e35-9d60-4933-ace0-b39c779851f1 service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-deleted-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-8be63e5f-812c-421c-b43c-6abb255d7021 req-d06550cd-0569-4759-8ad3-494b6b0b056e service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8be63e5f-812c-421c-b43c-6abb255d7021 req-d06550cd-0569-4759-8ad3-494b6b0b056e service nova] Acquiring lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8be63e5f-812c-421c-b43c-6abb255d7021 req-d06550cd-0569-4759-8ad3-494b6b0b056e service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8be63e5f-812c-421c-b43c-6abb255d7021 req-d06550cd-0569-4759-8ad3-494b6b0b056e service nova] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-8be63e5f-812c-421c-b43c-6abb255d7021 req-d06550cd-0569-4759-8ad3-494b6b0b056e service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] No waiting events found dispatching network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:58:35 user nova-compute[73450]: WARNING nova.compute.manager [req-8be63e5f-812c-421c-b43c-6abb255d7021 req-d06550cd-0569-4759-8ad3-494b6b0b056e service nova] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Received unexpected event network-vif-plugged-6a7c11f4-7da8-438a-847f-31ccfd4eceea for instance with vm_state active and task_state deleting.
Aug 16 16:58:35 user nova-compute[73450]: INFO nova.compute.manager [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 16:58:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:58:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:35 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Deleted allocations for instance 78128529-664d-4e24-9a7b-a242e67a2ddf
Aug 16 16:58:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-db25c08d-c5f5-414b-a896-95924082dd67 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "78128529-664d-4e24-9a7b-a242e67a2ddf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.051s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:44 user nova-compute[73450]: INFO nova.compute.manager [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Terminating instance
Aug 16 16:58:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-944ec9eb-c9b1-41b3-82af-14421fad977a req-9e26212b-aca8-405d-be07-83109af1a157 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-unplugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-944ec9eb-c9b1-41b3-82af-14421fad977a req-9e26212b-aca8-405d-be07-83109af1a157 service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-944ec9eb-c9b1-41b3-82af-14421fad977a req-9e26212b-aca8-405d-be07-83109af1a157 service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-944ec9eb-c9b1-41b3-82af-14421fad977a req-9e26212b-aca8-405d-be07-83109af1a157 service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-944ec9eb-c9b1-41b3-82af-14421fad977a req-9e26212b-aca8-405d-be07-83109af1a157 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-unplugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-944ec9eb-c9b1-41b3-82af-14421fad977a req-9e26212b-aca8-405d-be07-83109af1a157 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-unplugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:58:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Instance destroyed successfully.
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'resources' on Instance uuid d1731c4d-0c63-4394-b50e-2db9c23a6951 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-237743492',display_name='tempest-ServerRescueNegativeTestJSON-server-237743492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-237743492',id=14,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:44:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-5z2ybtij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:44:22Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=d1731c4d-0c63-4394-b50e-2db9c23a6951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "40122be5-d72a-4bef-8bbd-4899062d67fa", "address": "fa:16:3e:e0:87:92", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40122be5-d7", "ovs_interfaceid": "40122be5-d72a-4bef-8bbd-4899062d67fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG os_vif [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40122be5-d7, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:58:45 user nova-compute[73450]: INFO os_vif [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:87:92,bridge_name='br-int',has_traffic_filtering=True,id=40122be5-d72a-4bef-8bbd-4899062d67fa,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40122be5-d7')
Aug 16 16:58:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Deleting instance files /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951_del
Aug 16 16:58:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Deletion of /opt/stack/data/nova/instances/d1731c4d-0c63-4394-b50e-2db9c23a6951_del complete
Aug 16 16:58:45 user nova-compute[73450]: INFO nova.compute.manager [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Going to confirm migration 1 {{(pid=73450) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'info_cache' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-1390384c-b3df-4d7e-8f67-900a8f7cc0d8 req-27f058e0-ed24-483d-a1de-269a7ac4e8df service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-deleted-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:45 user nova-compute[73450]: INFO nova.compute.manager [req-1390384c-b3df-4d7e-8f67-900a8f7cc0d8 req-27f058e0-ed24-483d-a1de-269a7ac4e8df service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Neutron deleted interface 40122be5-d72a-4bef-8bbd-4899062d67fa; detaching it from the instance and deleting it from the info cache
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-1390384c-b3df-4d7e-8f67-900a8f7cc0d8 req-27f058e0-ed24-483d-a1de-269a7ac4e8df service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:58:45 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Took 0.58 seconds to deallocate network for instance.
Aug 16 16:58:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-1390384c-b3df-4d7e-8f67-900a8f7cc0d8 req-27f058e0-ed24-483d-a1de-269a7ac4e8df service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Detach interface failed, port_id=40122be5-d72a-4bef-8bbd-4899062d67fa, reason: Instance d1731c4d-0c63-4394-b50e-2db9c23a6951 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG nova.network.neutron [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:58:46 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Deleted allocations for instance d1731c4d-0c63-4394-b50e-2db9c23a6951
Aug 16 16:58:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'migration_context' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a4561537-9281-451e-b650-211bd87cf9a4 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:58:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.377s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:47 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Deleted allocation for migration aff104b8-8f41-4d1b-831e-579df4f97277
Aug 16 16:58:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-7212f00f-b272-472c-985d-9b7ed513538f req-0affe6af-cc52-4090-aeb2-f1eb66cc3b16 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:58:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7212f00f-b272-472c-985d-9b7ed513538f req-0affe6af-cc52-4090-aeb2-f1eb66cc3b16 service nova] Acquiring lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7212f00f-b272-472c-985d-9b7ed513538f req-0affe6af-cc52-4090-aeb2-f1eb66cc3b16 service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7212f00f-b272-472c-985d-9b7ed513538f req-0affe6af-cc52-4090-aeb2-f1eb66cc3b16 service nova] Lock "d1731c4d-0c63-4394-b50e-2db9c23a6951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-7212f00f-b272-472c-985d-9b7ed513538f req-0affe6af-cc52-4090-aeb2-f1eb66cc3b16 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] No waiting events found dispatching network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:58:47 user nova-compute[73450]: WARNING nova.compute.manager [req-7212f00f-b272-472c-985d-9b7ed513538f req-0affe6af-cc52-4090-aeb2-f1eb66cc3b16 service nova] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Received unexpected event network-vif-plugged-40122be5-d72a-4bef-8bbd-4899062d67fa for instance with vm_state deleted and task_state None.
Aug 16 16:58:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6a35eacd-8beb-4f3a-9f4f-cf453b986923 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.820s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:48 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205113.7409697, 78128529-664d-4e24-9a7b-a242e67a2ddf => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:58:48 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] VM Stopped (Lifecycle Event)
Aug 16 16:58:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3a62f6db-601a-46f7-9e9d-b181c07a31ec None None] [instance: 78128529-664d-4e24-9a7b-a242e67a2ddf] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:58:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:52 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:58:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:58:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:55 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:56 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:58:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205125.2075617, d1731c4d-0c63-4394-b50e-2db9c23a6951 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:59:00 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] VM Stopped (Lifecycle Event)
Aug 16 16:59:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-646f37b9-d93b-4e42-9266-096ba40fc378 None None] [instance: d1731c4d-0c63-4394-b50e-2db9c23a6951] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:01 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:59:01 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7478MB free_disk=23.803802490234375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 679cc7af-3bba-44b0-9d76-3f053f87dd80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 7b9ea34e-9305-4f7f-ae47-772f70a82dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:59:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-changed-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG nova.compute.manager [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Refreshing instance network info cache due to event network-changed-91b8fd3d-c79f-4518-b78a-0da24cad6653. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] Acquiring lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] Acquired lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG nova.network.neutron [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Refreshing network info cache for port 91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG nova.network.neutron [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updated VIF entry in instance network info cache for port 91b8fd3d-c79f-4518-b78a-0da24cad6653. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG nova.network.neutron [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating instance_info_cache with network_info: [{"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f57589d3-ba8c-4328-97e8-c9bafbb9d17a req-e1e67e59-54d1-410d-9b66-2ac76d5b2e85 service nova] Releasing lock "refresh_cache-1abb65ae-ec46-4759-8da9-a60ef495c2f2" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:03 user nova-compute[73450]: INFO nova.compute.manager [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] instance snapshotting
Aug 16 16:59:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Beginning live snapshot process
Aug 16 16:59:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json -f qcow2 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbu_lahom/d95c96d12b134aa89cfb296a6354a505.delta 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbu_lahom/d95c96d12b134aa89cfb296a6354a505.delta 1073741824" returned: 0 in 0.055s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:04 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 16:59:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:59:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73450) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 16:59:05 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 16:59:05 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:59:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbu_lahom/d95c96d12b134aa89cfb296a6354a505.delta /opt/stack/data/nova/instances/snapshots/tmpbu_lahom/d95c96d12b134aa89cfb296a6354a505 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbu_lahom/d95c96d12b134aa89cfb296a6354a505.delta /opt/stack/data/nova/instances/snapshots/tmpbu_lahom/d95c96d12b134aa89cfb296a6354a505" returned: 0 in 0.683s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:06 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Snapshot extracted, beginning image upload
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:06 user nova-compute[73450]: INFO nova.compute.manager [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attaching volume 1e716372-0e57-4cae-bb4e-9ac3b07a4541 to /dev/vdb
Aug 16 16:59:06 user nova-compute[73450]: DEBUG os_brick.utils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd31513b-ca88-43a6-a311-69e7d18c120c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764279e-9164-4bfd-829e-b948ebab4691]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb49d23-e6b7-410e-8ef2-eeff96a82d50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b431c51a-0474-42ee-a5e7-cce36ba4bbc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:59:06 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:59:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c5cd8-831a-413b-b2b6-c5224cbff408]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG os_brick.utils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:06 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating existing volume attachment record: d3d117fb-b402-4416-b960-fd45907f593c {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:59:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:08 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Snapshot image upload complete
Aug 16 16:59:08 user nova-compute[73450]: INFO nova.compute.manager [None req-3ef154d8-e06f-40b3-8443-58f59e47e9d8 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Took 5.38 seconds to snapshot the instance on the hypervisor.
Aug 16 16:59:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 16:59:11 user nova-compute[73450]: INFO nova.compute.claims [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Claim successful on node user
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.network.neutron [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 16:59:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 16:59:11 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Creating image(s)
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "/opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "/opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "a09ce228f023502eb4efbf4e120534dd849e1167" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "a09ce228f023502eb4efbf4e120534dd849e1167" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.part --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:12 user nova-compute[73450]: DEBUG nova.policy [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3204a7c592ff4585be593753006fd5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ace27d486848e4a6ae14949629da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 16:59:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:12 user nova-compute[73450]: DEBUG nova.virt.images [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] 1533d565-34f5-4f74-9df8-fb360c97c65f was qcow2, converting to raw {{(pid=73450) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 16:59:12 user nova-compute[73450]: DEBUG nova.privsep.utils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73450) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 16:59:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.part /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.converted {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.part /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.converted" returned: 0 in 0.611s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.converted --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "a09ce228f023502eb4efbf4e120534dd849e1167" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.085s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 --force-share --output=json" returned: 0 in 0.235s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "a09ce228f023502eb4efbf4e120534dd849e1167" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "a09ce228f023502eb4efbf4e120534dd849e1167" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG nova.network.neutron [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Successfully created port: 74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167,backing_fmt=raw /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167,backing_fmt=raw /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk 1073741824" returned: 0 in 0.074s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "a09ce228f023502eb4efbf4e120534dd849e1167" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 --force-share --output=json" returned: 0 in 0.212s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'migration_context' on Instance uuid 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Ensure instance console log exists: /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Successfully updated port: 74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquired lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-changed-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Refreshing instance network info cache due to event network-changed-74f25aaa-9274-4f83-8219-9e5f71443752. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] Acquiring lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updating instance_info_cache with network_info: [{"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Releasing lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Instance network_info: |[{"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] Acquired lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Refreshing network info cache for port 74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Start _get_guest_xml network_info=[{"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5c970be3a7a8e556c6837d407ef9ce01',container_format='bare',created_at=2023-08-16T16:59:03Z,direct_url=<?>,disk_format='qcow2',id=1533d565-34f5-4f74-9df8-fb360c97c65f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1989127067',owner='33ace27d486848e4a6ae14949629da11',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T16:59:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': '1533d565-34f5-4f74-9df8-fb360c97c65f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 16:59:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:59:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c970be3a7a8e556c6837d407ef9ce01',container_format='bare',created_at=2023-08-16T16:59:03Z,direct_url=<?>,disk_format='qcow2',id=1533d565-34f5-4f74-9df8-fb360c97c65f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1989127067',owner='33ace27d486848e4a6ae14949629da11',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T16:59:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-612633402',display_name='tempest-TestStampPattern-server-612633402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-612633402',id=40,image_ref='1533d565-34f5-4f74-9df8-fb360c97c65f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYwZqnqg7dO+ytxFjz6XdBi4yIzNz/7UrcYmlm0Yp3fzTPnQGAJvVEeoFigebR3Ay8FkG/g2G8In8fH/us7360kHsj5Ihla9q+Tr8gMmAHGnvFblbO8Eikw5YPaOPmJg==',key_name='tempest-TestStampPattern-481591227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ace27d486848e4a6ae14949629da11',ramdisk_id='',reservation_id='r-uo5d6bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b1da2b30-72cd-46f8-8620-d8c044e79c96',image_min_disk='1',image_min_ram='0',image_owner_id='33ace27d486848e4a6ae14949629da11',image_owner_project_name='tempest-TestStampPattern-1739750355',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1739750355-project-member',image_user_id='3204a7c592ff4585be593753006fd5bb',network_allocated='True',owner_project_name='tempest-TestStampPattern-1739750355',owner_user_name='tempest-TestStampPattern-1739750355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:59:12Z,user_data=None,user_id='3204a7c592ff4585be593753006fd5bb',uuid=1ab08e1c-6772-4081-b995-61c8d0b19057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converting VIF {"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.objects.instance [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] End _get_guest_xml xml=<domain type="kvm">
Aug 16 16:59:15 user nova-compute[73450]:   <uuid>1ab08e1c-6772-4081-b995-61c8d0b19057</uuid>
Aug 16 16:59:15 user nova-compute[73450]:   <name>instance-00000028</name>
Aug 16 16:59:15 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 16:59:15 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 16:59:15 user nova-compute[73450]:   <metadata>
Aug 16 16:59:15 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 16:59:15 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 16:59:15 user nova-compute[73450]:       <nova:name>tempest-TestStampPattern-server-612633402</nova:name>
Aug 16 16:59:15 user nova-compute[73450]:       <nova:creationTime>2023-08-16 16:59:15</nova:creationTime>
Aug 16 16:59:15 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 16:59:15 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 16:59:15 user nova-compute[73450]:       </nova:flavor>
Aug 16 16:59:15 user nova-compute[73450]:       <nova:owner>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:user uuid="3204a7c592ff4585be593753006fd5bb">tempest-TestStampPattern-1739750355-project-member</nova:user>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:project uuid="33ace27d486848e4a6ae14949629da11">tempest-TestStampPattern-1739750355</nova:project>
Aug 16 16:59:15 user nova-compute[73450]:       </nova:owner>
Aug 16 16:59:15 user nova-compute[73450]:       <nova:root type="image" uuid="1533d565-34f5-4f74-9df8-fb360c97c65f"/>
Aug 16 16:59:15 user nova-compute[73450]:       <nova:ports>
Aug 16 16:59:15 user nova-compute[73450]:         <nova:port uuid="74f25aaa-9274-4f83-8219-9e5f71443752">
Aug 16 16:59:15 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 16:59:15 user nova-compute[73450]:         </nova:port>
Aug 16 16:59:15 user nova-compute[73450]:       </nova:ports>
Aug 16 16:59:15 user nova-compute[73450]:     </nova:instance>
Aug 16 16:59:15 user nova-compute[73450]:   </metadata>
Aug 16 16:59:15 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 16:59:15 user nova-compute[73450]:     <system>
Aug 16 16:59:15 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 16:59:15 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 16:59:15 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 16:59:15 user nova-compute[73450]:       <entry name="serial">1ab08e1c-6772-4081-b995-61c8d0b19057</entry>
Aug 16 16:59:15 user nova-compute[73450]:       <entry name="uuid">1ab08e1c-6772-4081-b995-61c8d0b19057</entry>
Aug 16 16:59:15 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 16:59:15 user nova-compute[73450]:     </system>
Aug 16 16:59:15 user nova-compute[73450]:   </sysinfo>
Aug 16 16:59:15 user nova-compute[73450]:   <os>
Aug 16 16:59:15 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 16:59:15 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 16:59:15 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 16:59:15 user nova-compute[73450]:   </os>
Aug 16 16:59:15 user nova-compute[73450]:   <features>
Aug 16 16:59:15 user nova-compute[73450]:     <acpi/>
Aug 16 16:59:15 user nova-compute[73450]:     <apic/>
Aug 16 16:59:15 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 16:59:15 user nova-compute[73450]:   </features>
Aug 16 16:59:15 user nova-compute[73450]:   <clock offset="utc">
Aug 16 16:59:15 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 16:59:15 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 16:59:15 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 16:59:15 user nova-compute[73450]:   </clock>
Aug 16 16:59:15 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 16:59:15 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 16:59:15 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 16:59:15 user nova-compute[73450]:   </cpu>
Aug 16 16:59:15 user nova-compute[73450]:   <devices>
Aug 16 16:59:15 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 16:59:15 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 16:59:15 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk"/>
Aug 16 16:59:15 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 16:59:15 user nova-compute[73450]:     </disk>
Aug 16 16:59:15 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 16:59:15 user nova-compute[73450]:       <mac address="fa:16:3e:fd:7e:86"/>
Aug 16 16:59:15 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:59:15 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 16:59:15 user nova-compute[73450]:       <target dev="tap74f25aaa-92"/>
Aug 16 16:59:15 user nova-compute[73450]:     </interface>
Aug 16 16:59:15 user nova-compute[73450]:     <serial type="pty">
Aug 16 16:59:15 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/console.log" append="off"/>
Aug 16 16:59:15 user nova-compute[73450]:     </serial>
Aug 16 16:59:15 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 16:59:15 user nova-compute[73450]:     <video>
Aug 16 16:59:15 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 16:59:15 user nova-compute[73450]:     </video>
Aug 16 16:59:15 user nova-compute[73450]:     <rng model="virtio">
Aug 16 16:59:15 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 16:59:15 user nova-compute[73450]:     </rng>
Aug 16 16:59:15 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 16:59:15 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 16:59:15 user nova-compute[73450]:       <stats period="10"/>
Aug 16 16:59:15 user nova-compute[73450]:     </memballoon>
Aug 16 16:59:15 user nova-compute[73450]:   </devices>
Aug 16 16:59:15 user nova-compute[73450]: </domain>
Aug 16 16:59:15 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-612633402',display_name='tempest-TestStampPattern-server-612633402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-612633402',id=40,image_ref='1533d565-34f5-4f74-9df8-fb360c97c65f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYwZqnqg7dO+ytxFjz6XdBi4yIzNz/7UrcYmlm0Yp3fzTPnQGAJvVEeoFigebR3Ay8FkG/g2G8In8fH/us7360kHsj5Ihla9q+Tr8gMmAHGnvFblbO8Eikw5YPaOPmJg==',key_name='tempest-TestStampPattern-481591227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ace27d486848e4a6ae14949629da11',ramdisk_id='',reservation_id='r-uo5d6bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b1da2b30-72cd-46f8-8620-d8c044e79c96',image_min_disk='1',image_min_ram='0',image_owner_id='33ace27d486848e4a6ae14949629da11',image_owner_project_name='tempest-TestStampPattern-1739750355',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1739750355-project-member',image_user_id='3204a7c592ff4585be593753006fd5bb',network_allocated='True',owner_project_name='tempest-TestStampPattern-1739750355',owner_user_name='tempest-TestStampPattern-1739750355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T16:59:12Z,user_data=None,user_id='3204a7c592ff4585be593753006fd5bb',uuid=1ab08e1c-6772-4081-b995-61c8d0b19057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converting VIF {"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG os_vif [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74f25aaa-92, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74f25aaa-92, col_values=(('external_ids', {'iface-id': '74f25aaa-9274-4f83-8219-9e5f71443752', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:7e:86', 'vm-uuid': '1ab08e1c-6772-4081-b995-61c8d0b19057'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:15 user nova-compute[73450]: INFO os_vif [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92')
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No VIF found with MAC fa:16:3e:fd:7e:86, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updated VIF entry in instance network info cache for port 74f25aaa-9274-4f83-8219-9e5f71443752. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG nova.network.neutron [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updating instance_info_cache with network_info: [{"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8ee162be-75f0-45c7-af85-9f86650632bd req-39ce0343-aad0-4242-a122-198867a899a7 service nova] Releasing lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-efeaa144-d874-40cf-8dba-6ce081c78ae8 req-95c39cfa-09d5-4576-a6cd-8486fe1ee66d service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-efeaa144-d874-40cf-8dba-6ce081c78ae8 req-95c39cfa-09d5-4576-a6cd-8486fe1ee66d service nova] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-efeaa144-d874-40cf-8dba-6ce081c78ae8 req-95c39cfa-09d5-4576-a6cd-8486fe1ee66d service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-efeaa144-d874-40cf-8dba-6ce081c78ae8 req-95c39cfa-09d5-4576-a6cd-8486fe1ee66d service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-efeaa144-d874-40cf-8dba-6ce081c78ae8 req-95c39cfa-09d5-4576-a6cd-8486fe1ee66d service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] No waiting events found dispatching network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:17 user nova-compute[73450]: WARNING nova.compute.manager [req-efeaa144-d874-40cf-8dba-6ce081c78ae8 req-95c39cfa-09d5-4576-a6cd-8486fe1ee66d service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received unexpected event network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 for instance with vm_state building and task_state spawning.
Aug 16 16:59:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVwAqQOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:17 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed0bf54-08ff-4ead-874c-9bf15d07f4c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:59:17 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[379c7026-ed4c-4f43-88d9-c41b9b208583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541] added
Aug 16 16:59:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86efedf-b2ed-48fb-92bf-7f384cae42df]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[91249b2a-cb2d-4271-83eb-ca9508185eef]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVwAqQOX {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVwAqQOX" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d9da0e-386e-4232-b3de-eb58171d8fde]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vVwAqQOX'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be96e64-b360-4543-be6b-43930737f88c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.086s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f1fb8b-9924-472d-b3bf-0f4600488b13]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:18 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:59:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:18 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:59:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0e7b0-2c4d-486a-8814-f990e4de3476]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260]
Aug 16 16:59:18 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260] successful.
Aug 16 16:59:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398456d-7aa9-47c2-a773-f439cc5a7edd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e12678-a1a2-4ca1-93ff-77f77555cd7b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:18 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:59:18 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:18 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:59:18 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ca427-0825-46d3-8ee1-f0c79f0fb27b]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-bcd82ffa-5473-4cda-865f-5dc5abc534e7 req-ff892f63-0f9b-43ea-a228-37b8ac87e342 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bcd82ffa-5473-4cda-865f-5dc5abc534e7 req-ff892f63-0f9b-43ea-a228-37b8ac87e342 service nova] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bcd82ffa-5473-4cda-865f-5dc5abc534e7 req-ff892f63-0f9b-43ea-a228-37b8ac87e342 service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bcd82ffa-5473-4cda-865f-5dc5abc534e7 req-ff892f63-0f9b-43ea-a228-37b8ac87e342 service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [req-bcd82ffa-5473-4cda-865f-5dc5abc534e7 req-ff892f63-0f9b-43ea-a228-37b8ac87e342 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] No waiting events found dispatching network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:19 user nova-compute[73450]: WARNING nova.compute.manager [req-bcd82ffa-5473-4cda-865f-5dc5abc534e7 req-ff892f63-0f9b-43ea-a228-37b8ac87e342 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received unexpected event network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 for instance with vm_state building and task_state spawning.
Aug 16 16:59:19 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVwAqQOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26431613531333633', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431613531333633', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:59:19 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:19 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:59:19 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:59:19 user nova-compute[73450]:   <serial>1e716372-0e57-4cae-bb4e-9ac3b07a4541</serial>
Aug 16 16:59:19 user nova-compute[73450]: </disk>
Aug 16 16:59:19 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205159.577901, 1ab08e1c-6772-4081-b995-61c8d0b19057 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] VM Resumed (Lifecycle Event)
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Instance spawned successfully.
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205159.5780747, 1ab08e1c-6772-4081-b995-61c8d0b19057 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] VM Started (Lifecycle Event)
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Took 8.08 seconds to spawn the instance on the hypervisor.
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:19 user nova-compute[73450]: INFO nova.compute.manager [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Took 8.83 seconds to build instance.
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No VIF found with MAC fa:16:3e:ef:b9:4a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-3007e57e-86cf-4553-8d31-4403fb123daa tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.935s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d59e3297-7318-44cf-a775-38bf1c3470bd tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.584s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-changed-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:22 user nova-compute[73450]: DEBUG nova.compute.manager [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Refreshing instance network info cache due to event network-changed-96435f26-6d2b-485b-b5c0-1b9886daef40. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:59:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] Acquiring lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] Acquired lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:22 user nova-compute[73450]: DEBUG nova.network.neutron [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Refreshing network info cache for port 96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updated VIF entry in instance network info cache for port 96435f26-6d2b-485b-b5c0-1b9886daef40. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updating instance_info_cache with network_info: [{"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:23 user nova-compute[73450]: INFO nova.compute.manager [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Terminating instance
Aug 16 16:59:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68282e01-9579-43fb-a0ee-0361e7c375a2 req-b92c00c1-7fea-4995-ac09-aae333b7e9bc service nova] Releasing lock "refresh_cache-7b9ea34e-9305-4f7f-ae47-772f70a82dee" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Instance destroyed successfully.
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'resources' on Instance uuid 7b9ea34e-9305-4f7f-ae47-772f70a82dee {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-169056728',display_name='tempest-TestVolumeBootPattern-server-169056728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-169056728',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-pk71mqtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:57:49Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=7b9ea34e-9305-4f7f-ae47-772f70a82dee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "96435f26-6d2b-485b-b5c0-1b9886daef40", "address": "fa:16:3e:24:a0:f1", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96435f26-6d", "ovs_interfaceid": "96435f26-6d2b-485b-b5c0-1b9886daef40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_vif [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96435f26-6d, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:59:24 user nova-compute[73450]: INFO os_vif [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a0:f1,bridge_name='br-int',has_traffic_filtering=True,id=96435f26-6d2b-485b-b5c0-1b9886daef40,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96435f26-6d')
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:24 user nova-compute[73450]: INFO nova.compute.manager [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Terminating instance
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:24 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[20270b7f-0d29-4f3d-a455-448d66f07175]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c8c19-7d53-4c02-ab89-79741bb6feb4]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:24 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:59:24 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:24 user nova-compute[73450]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 16:59:24 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe280025750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ee2820-9354-4d88-9114-b4c2182cc41e]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca09f52a-d9bf-4a9b-bd72-2ce3cfc0d299]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c83566-9e74-4a80-9c51-ff4b5571ed91]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[46786f94-a836-4b3a-8674-6a4e0e78ac7d]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4125d78-9bae-4a47-b795-9d28cdad1822]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db96fc2-b662-46a1-ac9a-6bd0cf845143]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]
Aug 16 16:59:24 user nova-compute[73450]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.
Aug 16 16:59:24 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-e0ccdd8b-7461-40eb-9b69-2f08967528e5 req-4af314ad-f4ea-40cc-8172-ed96f129aefb service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-unplugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e0ccdd8b-7461-40eb-9b69-2f08967528e5 req-4af314ad-f4ea-40cc-8172-ed96f129aefb service nova] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e0ccdd8b-7461-40eb-9b69-2f08967528e5 req-4af314ad-f4ea-40cc-8172-ed96f129aefb service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e0ccdd8b-7461-40eb-9b69-2f08967528e5 req-4af314ad-f4ea-40cc-8172-ed96f129aefb service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-e0ccdd8b-7461-40eb-9b69-2f08967528e5 req-4af314ad-f4ea-40cc-8172-ed96f129aefb service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] No waiting events found dispatching network-vif-unplugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-e0ccdd8b-7461-40eb-9b69-2f08967528e5 req-4af314ad-f4ea-40cc-8172-ed96f129aefb service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-unplugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17dade-6ab8-4278-a973-dc4826c22c4e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== disconnect_volume: return (368ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:59:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Deleting instance files /opt/stack/data/nova/instances/7b9ea34e-9305-4f7f-ae47-772f70a82dee_del
Aug 16 16:59:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Deletion of /opt/stack/data/nova/instances/7b9ea34e-9305-4f7f-ae47-772f70a82dee_del complete
Aug 16 16:59:24 user nova-compute[73450]: INFO nova.compute.manager [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-vif-unplugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] No waiting events found dispatching network-vif-unplugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-vif-unplugged-96435f26-6d2b-485b-b5c0-1b9886daef40 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] Acquiring lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] No waiting events found dispatching network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:24 user nova-compute[73450]: WARNING nova.compute.manager [req-8943619c-11e8-4afa-90a5-ad620d9d5ab0 req-c784ca98-2399-4dcf-af8c-67f7fc06c9ce service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received unexpected event network-vif-plugged-96435f26-6d2b-485b-b5c0-1b9886daef40 for instance with vm_state active and task_state deleting.
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Instance destroyed successfully.
Aug 16 16:59:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lazy-loading 'resources' on Instance uuid 679cc7af-3bba-44b0-9d76-3f053f87dd80 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1266330888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1266330888',id=3,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:39:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f813e9d59945b58a7f0141fb29ca46',ramdisk_id='',reservation_id='r-bqq98cgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-311543227',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:40:50Z,user_data=None,user_id='3275ae2aaad34aa8adb49e5de0dbe238',uuid=679cc7af-3bba-44b0-9d76-3f053f87dd80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converting VIF {"id": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "address": "fa:16:3e:f1:78:90", "network": {"id": "2978045b-e4d5-473a-bcc2-6608857dd0c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-908950980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f813e9d59945b58a7f0141fb29ca46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c28ddf3-db", "ovs_interfaceid": "2c28ddf3-dbf0-484c-835e-99eb614a6238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_vif [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c28ddf3-db, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:59:25 user nova-compute[73450]: INFO os_vif [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:78:90,bridge_name='br-int',has_traffic_filtering=True,id=2c28ddf3-dbf0-484c-835e-99eb614a6238,network=Network(2978045b-e4d5-473a-bcc2-6608857dd0c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c28ddf3-db')
Aug 16 16:59:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Deleting instance files /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80_del
Aug 16 16:59:25 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Deletion of /opt/stack/data/nova/instances/679cc7af-3bba-44b0-9d76-3f053f87dd80_del complete
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:25 user nova-compute[73450]: INFO nova.compute.manager [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:25 user nova-compute[73450]: INFO nova.compute.manager [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attaching volume 61239cad-fd33-4e6c-b255-72ba23089f10 to /dev/vdc
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_brick.utils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d5d684-151e-4a02-a3a1-3ac931caad46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[310312bf-9cf6-4c67-8d53-5d4e2c2a1e0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da9aa5-720c-4c3d-b86c-2d3ef9950f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210c05f-d72a-45c2-8ed1-53821fbf7440]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:59:25 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:59:25 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9372d3a6-d6ee-489a-a159-c665760a5c2d]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG os_brick.utils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating existing volume attachment record: 5a07f67e-da49-48ef-b1bb-9ad158a91d08 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:26 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Took 1.02 seconds to deallocate network for instance.
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:26 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Took 1.72 seconds to deallocate network for instance.
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] No waiting events found dispatching network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:26 user nova-compute[73450]: WARNING nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received unexpected event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 for instance with vm_state deleted and task_state None.
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] Acquiring lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] No waiting events found dispatching network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:26 user nova-compute[73450]: WARNING nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received unexpected event network-vif-plugged-2c28ddf3-dbf0-484c-835e-99eb614a6238 for instance with vm_state deleted and task_state None.
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-923f753a-cb3b-4386-9350-86c54fd117d7 req-5eeb577e-bc8b-4992-a51e-4ec19a6da1d1 service nova] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Received event network-vif-deleted-96435f26-6d2b-485b-b5c0-1b9886daef40 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:26 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Deleted allocations for instance 679cc7af-3bba-44b0-9d76-3f053f87dd80
Aug 16 16:59:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-12b1a85d-c17c-4324-8813-d1053dacbdd1 tempest-ServerBootFromVolumeStableRescueTest-311543227 tempest-ServerBootFromVolumeStableRescueTest-311543227-project-member] Lock "679cc7af-3bba-44b0-9d76-3f053f87dd80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-93f8bf49-4eb7-40e2-bc80-49134909cc2d req-0f6167e2-573b-47ed-a297-984b9e706a35 service nova] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Received event network-vif-deleted-2c28ddf3-dbf0-484c-835e-99eb614a6238 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:27 user nova-compute[73450]: INFO nova.compute.manager [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Took 0.81 seconds to detach 1 volumes for instance.
Aug 16 16:59:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:27 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:59:27 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:59:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:27 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Deleted allocations for instance 7b9ea34e-9305-4f7f-ae47-772f70a82dee
Aug 16 16:59:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1770b55a-7a50-40d4-a3b3-c4590bb43f79 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "7b9ea34e-9305-4f7f-ae47-772f70a82dee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.481s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:35 user nova-compute[73450]: INFO nova.compute.manager [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Terminating instance
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-6029e7ac-ff2a-4020-82e3-8c410709bf19 req-c8e0afe8-4092-4c22-8464-146d72cf769b service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6029e7ac-ff2a-4020-82e3-8c410709bf19 req-c8e0afe8-4092-4c22-8464-146d72cf769b service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6029e7ac-ff2a-4020-82e3-8c410709bf19 req-c8e0afe8-4092-4c22-8464-146d72cf769b service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6029e7ac-ff2a-4020-82e3-8c410709bf19 req-c8e0afe8-4092-4c22-8464-146d72cf769b service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-6029e7ac-ff2a-4020-82e3-8c410709bf19 req-c8e0afe8-4092-4c22-8464-146d72cf769b service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-6029e7ac-ff2a-4020-82e3-8c410709bf19 req-c8e0afe8-4092-4c22-8464-146d72cf769b service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-unplugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:59:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Instance destroyed successfully.
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lazy-loading 'resources' on Instance uuid 767812ec-7b5d-414e-ae14-a0bb1ccfb13b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812468752',display_name='tempest-ServerRescueNegativeTestJSON-server-1812468752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812468752',id=13,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad178c8525774ad2a342015b9dc1fbf2',ramdisk_id='',reservation_id='r-st8v3bwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-976614040',owner_user_name='tempest-ServerRescueNegativeTestJSON-976614040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:49:11Z,user_data=None,user_id='19d604d793314808984e92afdc5f5da0',uuid=767812ec-7b5d-414e-ae14-a0bb1ccfb13b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converting VIF {"id": "f14ce5dd-9557-437f-b006-8749709a9013", "address": "fa:16:3e:93:4b:c7", "network": {"id": "9873798c-a15c-42cc-b919-6896db7ec8c9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1625943496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad178c8525774ad2a342015b9dc1fbf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14ce5dd-95", "ovs_interfaceid": "f14ce5dd-9557-437f-b006-8749709a9013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG os_vif [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf14ce5dd-95, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:59:35 user nova-compute[73450]: INFO os_vif [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:4b:c7,bridge_name='br-int',has_traffic_filtering=True,id=f14ce5dd-9557-437f-b006-8749709a9013,network=Network(9873798c-a15c-42cc-b919-6896db7ec8c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14ce5dd-95')
Aug 16 16:59:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Deleting instance files /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b_del
Aug 16 16:59:35 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Deletion of /opt/stack/data/nova/instances/767812ec-7b5d-414e-ae14-a0bb1ccfb13b_del complete
Aug 16 16:59:36 user nova-compute[73450]: INFO nova.compute.manager [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRUJIult', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:36 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae73890-8463-465f-a8c9-4cbe380036bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:59:36 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Took 0.73 seconds to deallocate network for instance.
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c2eae17-c8df-4477-8ea1-818437aca126 req-ee15113f-47dc-46f6-827d-be433c763bba service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-deleted-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:36 user nova-compute[73450]: INFO nova.compute.manager [req-1c2eae17-c8df-4477-8ea1-818437aca126 req-ee15113f-47dc-46f6-827d-be433c763bba service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Neutron deleted interface f14ce5dd-9557-437f-b006-8749709a9013; detaching it from the instance and deleting it from the info cache
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.network.neutron [req-1c2eae17-c8df-4477-8ea1-818437aca126 req-ee15113f-47dc-46f6-827d-be433c763bba service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b12f402-4b87-40df-ba22-bc67c057bbc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10] added
Aug 16 16:59:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-1c2eae17-c8df-4477-8ea1-818437aca126 req-ee15113f-47dc-46f6-827d-be433c763bba service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Detach interface failed, port_id=f14ce5dd-9557-437f-b006-8749709a9013, reason: Instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbc7a7-0dc5-4dfa-b354-3a192c35e67b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[653467c3-e7dd-45b1-92b0-f4ded71b17e6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRUJIult {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRUJIult" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151ba0e-14fb-489a-a412-dca7b7605872]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRUJIult'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17d0f8-77b1-44ec-b531-e06e2562f9bb]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'flavor' on Instance uuid 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[688bf9b0-8e2b-4808-b1a5-cc3580fc6bdb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:36 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:36 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4931f393-49d7-42db-881d-c2692ca133ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260]
Aug 16 16:59:36 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260] successful.
Aug 16 16:59:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3541e6ae-4234-4b33-9c60-6f57ed2c83f5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b1a0e-25c0-4b9f-aa68-fe99d8e0d34a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:37 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:37 user nova-compute[73450]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)
Aug 16 16:59:37 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:37 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:37 user nova-compute[73450]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)
Aug 16 16:59:37 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68f931-c701-4386-a12d-12ff3fae7715]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRUJIult', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:37 user nova-compute[73450]: INFO nova.compute.manager [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Attaching volume b1f30b0d-d0db-408b-b35d-24b447e44160 to /dev/vdb
Aug 16 16:59:37 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Deleted allocations for instance 767812ec-7b5d-414e-ae14-a0bb1ccfb13b
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.utils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f2050-8030-4ba9-b470-af38a41af23f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5f0fd-7d64-4c5d-b650-c94ced845dda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9a056d68-b5bc-4f3c-9e7d-faa1bfac4b51 tempest-ServerRescueNegativeTestJSON-976614040 tempest-ServerRescueNegativeTestJSON-976614040-project-member] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5119b49-2071-4147-baa5-a136e08f1d4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[16210416-86b6-4456-a105-2e7a8e65e469]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 16:59:37 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bbcfee-4698-4e0a-b542-7a93046defd6]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG os_brick.utils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating existing volume attachment record: ec2e3256-4497-4e0e-b05d-47cfbf03d158 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-e98bc313-c5d2-4448-86f8-5d4e1f980b10 req-9302153d-6e8e-4a2a-b0b6-175875c60326 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e98bc313-c5d2-4448-86f8-5d4e1f980b10 req-9302153d-6e8e-4a2a-b0b6-175875c60326 service nova] Acquiring lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e98bc313-c5d2-4448-86f8-5d4e1f980b10 req-9302153d-6e8e-4a2a-b0b6-175875c60326 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-e98bc313-c5d2-4448-86f8-5d4e1f980b10 req-9302153d-6e8e-4a2a-b0b6-175875c60326 service nova] Lock "767812ec-7b5d-414e-ae14-a0bb1ccfb13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-e98bc313-c5d2-4448-86f8-5d4e1f980b10 req-9302153d-6e8e-4a2a-b0b6-175875c60326 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] No waiting events found dispatching network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:37 user nova-compute[73450]: WARNING nova.compute.manager [req-e98bc313-c5d2-4448-86f8-5d4e1f980b10 req-9302153d-6e8e-4a2a-b0b6-175875c60326 service nova] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Received unexpected event network-vif-plugged-f14ce5dd-9557-437f-b006-8749709a9013 for instance with vm_state deleted and task_state None.
Aug 16 16:59:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26336346366616639', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336346366616639', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:59:38 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:38 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:59:38 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:59:38 user nova-compute[73450]:   <serial>61239cad-fd33-4e6c-b255-72ba23089f10</serial>
Aug 16 16:59:38 user nova-compute[73450]: </disk>
Aug 16 16:59:38 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] No VIF found with MAC fa:16:3e:ef:b9:4a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:59:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-114fbb08-8b56-4b10-babf-a0cf93e3d5ce tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.142s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:39 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205164.0926967, 7b9ea34e-9305-4f7f-ae47-772f70a82dee => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:59:39 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] VM Stopped (Lifecycle Event)
Aug 16 16:59:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f388afc6-c6a0-4d72-9a67-e09c72ae80a5 None None] [instance: 7b9ea34e-9305-4f7f-ae47-772f70a82dee] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:39 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205164.9838545, 679cc7af-3bba-44b0-9d76-3f053f87dd80 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:59:39 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] VM Stopped (Lifecycle Event)
Aug 16 16:59:39 user nova-compute[73450]: INFO nova.compute.manager [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Detaching volume 1e716372-0e57-4cae-bb4e-9ac3b07a4541
Aug 16 16:59:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.compute.manager [None req-03fcc616-bd13-4d1c-91b9-0ca257056f46 None None] [instance: 679cc7af-3bba-44b0-9d76-3f053f87dd80] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:40 user nova-compute[73450]: INFO nova.virt.block_device [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attempting to driver detach volume 1e716372-0e57-4cae-bb4e-9ac3b07a4541 from mountpoint /dev/vdb
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Attempting to detach device vdb from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:59:40 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:40 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:59:40 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:59:40 user nova-compute[73450]:   <serial>1e716372-0e57-4cae-bb4e-9ac3b07a4541</serial>
Aug 16 16:59:40 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:59:40 user nova-compute[73450]: </disk>
Aug 16 16:59:40 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:59:40 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully detached device vdb from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the persistent domain config.
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:59:40 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:40 user nova-compute[73450]:   <source dev="/dev/sdd"/>
Aug 16 16:59:40 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:59:40 user nova-compute[73450]:   <serial>1e716372-0e57-4cae-bb4e-9ac3b07a4541</serial>
Aug 16 16:59:40 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 16:59:40 user nova-compute[73450]: </disk>
Aug 16 16:59:40 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205180.564197, 1abb65ae-ec46-4759-8da9-a60ef495c2f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:59:40 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully detached device vdb from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the live domain config.
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVwAqQOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:40 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87aed3-2632-4bd8-86df-c09bd70a295f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c7de0-e944-4490-98ba-ed50f7869e26]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:40 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:40 user nova-compute[73450]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)
Aug 16 16:59:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:40 user nova-compute[73450]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 (non-flash)
Aug 16 16:59:40 user nova-compute[73450]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)
Aug 16 16:59:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe25060af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[859b1f2a-c275-4cac-81d1-db933182a4b3]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb75d4-2395-4e66-92fe-f87017970e0d]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ef9270-9d08-4158-be85-ddc2cdb64db4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8051f39c-edca-4890-bb82-1be1a6b23f6c]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed7c22f-f729-497f-8771-2bbfdae7f0c5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8128a0-3c46-43ec-9988-bcf43ddb1cd6]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260]
Aug 16 16:59:40 user nova-compute[73450]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541, portal: 172.16.0.220,3260] successful.
Aug 16 16:59:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e716372-0e57-4cae-bb4e-9ac3b07a4541 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1319c666-9f7b-443d-acf1-73d6abcca2d6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== disconnect_volume: return (301ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:59:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-bbb72ec0-4477-4977-b474-a40ff319c021 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:42 user nova-compute[73450]: INFO nova.compute.manager [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Detaching volume 61239cad-fd33-4e6c-b255-72ba23089f10
Aug 16 16:59:42 user nova-compute[73450]: INFO nova.virt.block_device [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Attempting to driver detach volume 61239cad-fd33-4e6c-b255-72ba23089f10 from mountpoint /dev/vdc
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Attempting to detach device vdc from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:59:42 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:42 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:59:42 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:59:42 user nova-compute[73450]:   <serial>61239cad-fd33-4e6c-b255-72ba23089f10</serial>
Aug 16 16:59:42 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 16:59:42 user nova-compute[73450]: </disk>
Aug 16 16:59:42 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:59:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully detached device vdc from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the persistent domain config.
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 16:59:42 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:42 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:59:42 user nova-compute[73450]:   <target dev="vdc" bus="virtio"/>
Aug 16 16:59:42 user nova-compute[73450]:   <serial>61239cad-fd33-4e6c-b255-72ba23089f10</serial>
Aug 16 16:59:42 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 16:59:42 user nova-compute[73450]: </disk>
Aug 16 16:59:42 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205182.9786527, 1abb65ae-ec46-4759-8da9-a60ef495c2f2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 16:59:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully detached device vdc from instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 from the live domain config.
Aug 16 16:59:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRUJIult', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:42 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 16:59:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d4987-f68c-4864-8704-0438c650ed97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f041d3bf-af9e-4eea-8cce-e5559f0e3d74]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:43 user nova-compute[73450]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)
Aug 16 16:59:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:43 user nova-compute[73450]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 (non-flash)
Aug 16 16:59:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe250608af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2fe363-dbca-4051-a4ce-a7570ac97e7c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d220d013-03e8-4bc3-abec-fb7024ee8986]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[68112548-4e89-4643-a1df-0b104255833e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[90043c2f-b25e-487f-829f-295d3b7809e9]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675a509-28c7-4d7b-9534-42c340c7bca9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36c3f26-9d27-4aa7-b901-c4ebfefd8f2d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260]
Aug 16 16:59:43 user nova-compute[73450]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10, portal: 172.16.0.220,3260] successful.
Aug 16 16:59:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61239cad-fd33-4e6c-b255-72ba23089f10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabe311-d46c-4257-922a-2403a07bbe0a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] <== disconnect_volume: return (280ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 16:59:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'flavor' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-e4066ec6-3d4d-4193-bb3b-bcedb3110024 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.790s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:45 user nova-compute[73450]: INFO nova.compute.manager [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Terminating instance
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-da360912-7068-40a2-8891-94445805a327 req-9c46b714-ab73-41da-903b-7a8f5a5fe658 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-vif-unplugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-da360912-7068-40a2-8891-94445805a327 req-9c46b714-ab73-41da-903b-7a8f5a5fe658 service nova] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-da360912-7068-40a2-8891-94445805a327 req-9c46b714-ab73-41da-903b-7a8f5a5fe658 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-da360912-7068-40a2-8891-94445805a327 req-9c46b714-ab73-41da-903b-7a8f5a5fe658 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-da360912-7068-40a2-8891-94445805a327 req-9c46b714-ab73-41da-903b-7a8f5a5fe658 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] No waiting events found dispatching network-vif-unplugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-da360912-7068-40a2-8891-94445805a327 req-9c46b714-ab73-41da-903b-7a8f5a5fe658 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-vif-unplugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Instance destroyed successfully.
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lazy-loading 'resources' on Instance uuid 1abb65ae-ec46-4759-8da9-a60ef495c2f2 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1334898268',display_name='tempest-AttachVolumeTestJSON-server-1334898268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1334898268',id=37,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm+ldZwP18dBBanbGPTCxDmNOjOYTyerXJAbmlHQx5eFBk5adWROoVxPBDKuoJZwgUatGE7ibUKAjGcX7nrD4ebqBJU2lueW2wk2WLWz/Znn/NqTNz8sOFsXTkOAtgZnA==',key_name='tempest-keypair-915964222',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:57:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1acac15e03f4d6188cb3517a7901da4',ramdisk_id='',reservation_id='r-14vkts2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570659826',owner_user_name='tempest-AttachVolumeTestJSON-570659826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba47a29f14cc441e826c9af67f20c96a',uuid=1abb65ae-ec46-4759-8da9-a60ef495c2f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converting VIF {"id": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "address": "fa:16:3e:ef:b9:4a", "network": {"id": "863949af-2ac8-40de-a728-3856ab6bb0f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-495354222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1acac15e03f4d6188cb3517a7901da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b8fd3d-c7", "ovs_interfaceid": "91b8fd3d-c79f-4518-b78a-0da24cad6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG os_vif [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91b8fd3d-c7, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:59:45 user nova-compute[73450]: INFO os_vif [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b9:4a,bridge_name='br-int',has_traffic_filtering=True,id=91b8fd3d-c79f-4518-b78a-0da24cad6653,network=Network(863949af-2ac8-40de-a728-3856ab6bb0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b8fd3d-c7')
Aug 16 16:59:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Deleting instance files /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2_del
Aug 16 16:59:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Deletion of /opt/stack/data/nova/instances/1abb65ae-ec46-4759-8da9-a60ef495c2f2_del complete
Aug 16 16:59:46 user nova-compute[73450]: INFO nova.compute.manager [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 16:59:46 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:59:46 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:59:46 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-abe70a5d-b6b3-4aee-a4b4-ebd5352f606c req-60bfa6c7-0237-4ab2-bd46-3e05d7940a50 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-abe70a5d-b6b3-4aee-a4b4-ebd5352f606c req-60bfa6c7-0237-4ab2-bd46-3e05d7940a50 service nova] Acquiring lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-abe70a5d-b6b3-4aee-a4b4-ebd5352f606c req-60bfa6c7-0237-4ab2-bd46-3e05d7940a50 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-abe70a5d-b6b3-4aee-a4b4-ebd5352f606c req-60bfa6c7-0237-4ab2-bd46-3e05d7940a50 service nova] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-abe70a5d-b6b3-4aee-a4b4-ebd5352f606c req-60bfa6c7-0237-4ab2-bd46-3e05d7940a50 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] No waiting events found dispatching network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:47 user nova-compute[73450]: WARNING nova.compute.manager [req-abe70a5d-b6b3-4aee-a4b4-ebd5352f606c req-60bfa6c7-0237-4ab2-bd46-3e05d7940a50 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received unexpected event network-vif-plugged-91b8fd3d-c79f-4518-b78a-0da24cad6653 for instance with vm_state active and task_state deleting.
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-1fe1f49e-36fe-442a-9f75-a8c238a56679 req-030a12ab-6688-4f0a-85cc-595752a4aec4 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Received event network-vif-deleted-91b8fd3d-c79f-4518-b78a-0da24cad6653 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:47 user nova-compute[73450]: INFO nova.compute.manager [req-1fe1f49e-36fe-442a-9f75-a8c238a56679 req-030a12ab-6688-4f0a-85cc-595752a4aec4 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Neutron deleted interface 91b8fd3d-c79f-4518-b78a-0da24cad6653; detaching it from the instance and deleting it from the info cache
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-1fe1f49e-36fe-442a-9f75-a8c238a56679 req-030a12ab-6688-4f0a-85cc-595752a4aec4 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:47 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Took 1.49 seconds to deallocate network for instance.
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-1fe1f49e-36fe-442a-9f75-a8c238a56679 req-030a12ab-6688-4f0a-85cc-595752a4aec4 service nova] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Detach interface failed, port_id=91b8fd3d-c79f-4518-b78a-0da24cad6653, reason: Instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2 could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:47 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Deleted allocations for instance 1abb65ae-ec46-4759-8da9-a60ef495c2f2
Aug 16 16:59:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-074cb0e9-7d52-46fc-9da9-0fe6c7896e73 tempest-AttachVolumeTestJSON-570659826 tempest-AttachVolumeTestJSON-570659826-project-member] Lock "1abb65ae-ec46-4759-8da9-a60ef495c2f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.830s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFRZeNwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 16:59:48 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:48 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 16:59:48 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8efa7e4-b23d-49d2-a055-2336e5e259c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 16:59:48 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec59b3a2-38ac-4268-9e8d-72ada31fb5c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160] added
Aug 16 16:59:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb948a5e-a1a3-4ed8-9aae-90e4e96a455b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7cd4bf-65c3-4898-bb77-cf405a24170b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFRZeNwM {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFRZeNwM" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15a0d88-9d89-42cc-b244-f86593947f15]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFRZeNwM'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c29fb-e74c-42d6-b783-42e92804fe51]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b93511-1444-41bc-8fba-123438c638e2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58b211-0bce-489a-9f25-c57b83e85ef5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260]
Aug 16 16:59:48 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260] successful.
Aug 16 16:59:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b879b1-5eb0-4ebc-a2f1-c768b4473ea1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3435aa1d-b086-464b-95ad-07c6b79476c6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:48 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 16:59:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 16:59:48 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 16:59:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05dc131-1330-4cdd-9680-06ab8b8d582e]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 16:59:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFRZeNwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 16:59:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 16:59:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23731333461613365', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 16:59:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731333461613365', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 16:59:49 user nova-compute[73450]: DEBUG nova.objects.instance [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'flavor' on Instance uuid 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 16:59:49 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 16:59:49 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 16:59:49 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 16:59:49 user nova-compute[73450]:   <serial>b1f30b0d-d0db-408b-b35d-24b447e44160</serial>
Aug 16 16:59:49 user nova-compute[73450]: </disk>
Aug 16 16:59:49 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 16:59:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 16:59:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] No VIF found with MAC fa:16:3e:8b:d7:aa, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 16:59:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-af133f5d-8352-4db0-8127-6621c6f11000 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.236s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:50 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205175.8797603, 767812ec-7b5d-414e-ae14-a0bb1ccfb13b => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:59:50 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] VM Stopped (Lifecycle Event)
Aug 16 16:59:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-31412628-6418-4ade-9602-ab2fcadaf126 None None] [instance: 767812ec-7b5d-414e-ae14-a0bb1ccfb13b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid eed98e2e-e225-483c-93bf-b8100e2bc5fe {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:59:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [{"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-eed98e2e-e225-483c-93bf-b8100e2bc5fe" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing instance network info cache due to event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:53 user nova-compute[73450]: DEBUG nova.network.neutron [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:59:54 user nova-compute[73450]: DEBUG nova.network.neutron [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updated VIF entry in instance network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:59:54 user nova-compute[73450]: DEBUG nova.network.neutron [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70a558a3-4e49-4820-8732-ed7cd5295b38 req-39ba9eda-98b4-4033-a8af-da4376e344a4 service nova] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing instance network info cache due to event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:55 user nova-compute[73450]: INFO nova.compute.manager [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Rebooting instance
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updated VIF entry in instance network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-31161b95-823c-4f5f-9eab-797c719fc961 req-9a146c48-5546-4e77-9e75-61b22ba038f1 service nova] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 16:59:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:56 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:59:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 16:59:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:59:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa572a87-58a4-4437-bade-78ffd462539d req-d5a23055-a3a5-4261-915d-ec0e20701162 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-unplugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa572a87-58a4-4437-bade-78ffd462539d req-d5a23055-a3a5-4261-915d-ec0e20701162 service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa572a87-58a4-4437-bade-78ffd462539d req-d5a23055-a3a5-4261-915d-ec0e20701162 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa572a87-58a4-4437-bade-78ffd462539d req-d5a23055-a3a5-4261-915d-ec0e20701162 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa572a87-58a4-4437-bade-78ffd462539d req-d5a23055-a3a5-4261-915d-ec0e20701162 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-unplugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:59:58 user nova-compute[73450]: WARNING nova.compute.manager [req-aa572a87-58a4-4437-bade-78ffd462539d req-d5a23055-a3a5-4261-915d-ec0e20701162 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-unplugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state active and task_state reboot_started.
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:59 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance shutdown successfully.
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 16:59:59 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205185.9334466, 1abb65ae-ec46-4759-8da9-a60ef495c2f2 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:03 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] VM Stopped (Lifecycle Event)
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d32127c-e9c7-4629-9153-fb592defe2e9 req-aa9e06f9-a3c9-4fe1-91c9-7ca377534192 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d32127c-e9c7-4629-9153-fb592defe2e9 req-aa9e06f9-a3c9-4fe1-91c9-7ca377534192 service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d32127c-e9c7-4629-9153-fb592defe2e9 req-aa9e06f9-a3c9-4fe1-91c9-7ca377534192 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9d32127c-e9c7-4629-9153-fb592defe2e9 req-aa9e06f9-a3c9-4fe1-91c9-7ca377534192 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-9d32127c-e9c7-4629-9153-fb592defe2e9 req-aa9e06f9-a3c9-4fe1-91c9-7ca377534192 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:03 user nova-compute[73450]: WARNING nova.compute.manager [req-9d32127c-e9c7-4629-9153-fb592defe2e9 req-aa9e06f9-a3c9-4fe1-91c9-7ca377534192 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state active and task_state reboot_started.
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:03 user nova-compute[73450]: WARNING nova.compute.manager [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state active and task_state reboot_started.
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:03 user nova-compute[73450]: WARNING nova.compute.manager [req-3fa8ee0e-d4de-435e-ac6c-2c46f0c1f6c3 req-c6c42d21-3ffd-4ffd-af22-ce1fd4b74337 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state active and task_state reboot_started.
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Removed pending event for 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a due to event {{(pid=73450) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205203.0503957, 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:03 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] VM Resumed (Lifecycle Event)
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fa4ad2d7-765b-4375-aedc-54c07de279fd None None] [instance: 1abb65ae-ec46-4759-8da9-a60ef495c2f2] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:00:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:00:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8098MB free_disk=23.82709503173828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance running successfully.
Aug 16 17:00:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance soft rebooted successfully.
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:00:03 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205203.0512965, 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:03 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] VM Started (Lifecycle Event)
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1225e5d6-4e9f-48be-bf33-b1d242a1927f tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.589s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1ab08e1c-6772-4081-b995-61c8d0b19057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:00:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:00:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 17:00:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 17:00:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:00:15 user nova-compute[73450]: INFO nova.compute.claims [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Claim successful on node user
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:00:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:00:16 user nova-compute[73450]: INFO nova.virt.block_device [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Booting with volume f7b3212d-3717-4356-bc68-29ec6e56effc at /dev/vda
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.policy [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c95d246b43b45b4963f9d750ae89fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b953d82d634106aa0fb9574fafdc0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG os_brick.utils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50b5ac8-753d-4ecd-96ed-2995e3d077ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c621308-9a52-4490-afa2-74e7bd3a5180]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba87c725-c871-47ac-a136-576068f1bd8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae05e7-690f-479b-a427-9dbb3b736951]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:00:16 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:00:16 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82e83d-7cf7-4aed-ab04-195b03dd0219]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG os_brick.utils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:00:16 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating existing volume attachment record: b8a1348d-178a-49aa-9363-91d8e1f38e88 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:00:17 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Successfully created port: 222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Successfully updated port: 222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquired lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-changed-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Refreshing instance network info cache due to event network-changed-222466b9-1077-4286-a384-e20478d68c1a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] Acquiring lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:00:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG nova.network.neutron [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating instance_info_cache with network_info: [{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Releasing lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Instance network_info: |[{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] Acquired lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Refreshing network info cache for port 222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updated VIF entry in instance network info cache for port 222466b9-1077-4286-a384-e20478d68c1a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating instance_info_cache with network_info: [{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:00:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fb06ef1f-2558-4b3b-8bc9-aa5e622139aa req-618a6869-0ffe-424f-8f57-8309d27f6f07 service nova] Releasing lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:00:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:00:27 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Creating image(s)
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Ensure instance console log exists: /opt/stack/data/nova/instances/d2e7d814-bd0b-45f6-b1e4-59e24398fa95/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Start _get_guest_xml network_info=[{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'b8a1348d-178a-49aa-9363-91d8e1f38e88', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2e7d814-bd0b-45f6-b1e4-59e24398fa95', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7b3212d-3717-4356-bc68-29ec6e56effc', 'serial': 'f7b3212d-3717-4356-bc68-29ec6e56effc'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:00:27 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:00:27 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:00:27 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:00:27 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:00:27 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb142b05-2219-4384-a85a-096744e2eaf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:00:27 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03320033-d415-42c0-895c-254fb9e83d53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc] added
Aug 16 17:00:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f382c-616b-4b73-95b0-21cf9d87c859]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f29d188-7752-48a6-a847-7f971b631f31]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrNaovBZ {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrNaovBZ" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b5d23d-e715-42ab-ae46-7004445cb9c0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrNaovBZ'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3652639-b804-4cc4-82d4-361b96aa3ded]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e0a1d-c31e-46cc-aa22-4910d40f290f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:00:27 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:00:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:00:27 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:00:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e18297a-5387-4ec9-88bd-f2d552280097]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]
Aug 16 17:00:27 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.
Aug 16 17:00:27 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:27 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c7baf-a03f-450c-8382-036a5266af10]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5230984-0b96-4c1d-baed-3cdc910d572d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:00:28 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:00:28 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:00:28 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:00:28 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:00:28 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:00:28 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd0bb3-bfa3-4367-b78a-956f1bd28a60]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23261313438643937', 'path': '/dev/sdd'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261313438643937', 'path': '/dev/sdd'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1685193865',display_name='tempest-TestVolumeBootPattern-server-1685193865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1685193865',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-15hhtq4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:00:16Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=d2e7d814-bd0b-45f6-b1e4-59e24398fa95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'pci_devices' on Instance uuid d2e7d814-bd0b-45f6-b1e4-59e24398fa95 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:00:29 user nova-compute[73450]:   <uuid>d2e7d814-bd0b-45f6-b1e4-59e24398fa95</uuid>
Aug 16 17:00:29 user nova-compute[73450]:   <name>instance-00000029</name>
Aug 16 17:00:29 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:00:29 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:00:29 user nova-compute[73450]:   <metadata>
Aug 16 17:00:29 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:00:29 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:00:29 user nova-compute[73450]:       <nova:name>tempest-TestVolumeBootPattern-server-1685193865</nova:name>
Aug 16 17:00:29 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:00:27</nova:creationTime>
Aug 16 17:00:29 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:00:29 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:00:29 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:00:29 user nova-compute[73450]:       <nova:owner>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:user uuid="8c95d246b43b45b4963f9d750ae89fbd">tempest-TestVolumeBootPattern-717711848-project-member</nova:user>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:project uuid="a3b953d82d634106aa0fb9574fafdc0d">tempest-TestVolumeBootPattern-717711848</nova:project>
Aug 16 17:00:29 user nova-compute[73450]:       </nova:owner>
Aug 16 17:00:29 user nova-compute[73450]:       <nova:ports>
Aug 16 17:00:29 user nova-compute[73450]:         <nova:port uuid="222466b9-1077-4286-a384-e20478d68c1a">
Aug 16 17:00:29 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 17:00:29 user nova-compute[73450]:         </nova:port>
Aug 16 17:00:29 user nova-compute[73450]:       </nova:ports>
Aug 16 17:00:29 user nova-compute[73450]:     </nova:instance>
Aug 16 17:00:29 user nova-compute[73450]:   </metadata>
Aug 16 17:00:29 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:00:29 user nova-compute[73450]:     <system>
Aug 16 17:00:29 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:00:29 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:00:29 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:00:29 user nova-compute[73450]:       <entry name="serial">d2e7d814-bd0b-45f6-b1e4-59e24398fa95</entry>
Aug 16 17:00:29 user nova-compute[73450]:       <entry name="uuid">d2e7d814-bd0b-45f6-b1e4-59e24398fa95</entry>
Aug 16 17:00:29 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:00:29 user nova-compute[73450]:     </system>
Aug 16 17:00:29 user nova-compute[73450]:   </sysinfo>
Aug 16 17:00:29 user nova-compute[73450]:   <os>
Aug 16 17:00:29 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:00:29 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:00:29 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:00:29 user nova-compute[73450]:   </os>
Aug 16 17:00:29 user nova-compute[73450]:   <features>
Aug 16 17:00:29 user nova-compute[73450]:     <acpi/>
Aug 16 17:00:29 user nova-compute[73450]:     <apic/>
Aug 16 17:00:29 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:00:29 user nova-compute[73450]:   </features>
Aug 16 17:00:29 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:00:29 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:00:29 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:00:29 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:00:29 user nova-compute[73450]:   </clock>
Aug 16 17:00:29 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:00:29 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:00:29 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:00:29 user nova-compute[73450]:   </cpu>
Aug 16 17:00:29 user nova-compute[73450]:   <devices>
Aug 16 17:00:29 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 17:00:29 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:00:29 user nova-compute[73450]:       <source dev="/dev/sdd"/>
Aug 16 17:00:29 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:00:29 user nova-compute[73450]:       <serial>f7b3212d-3717-4356-bc68-29ec6e56effc</serial>
Aug 16 17:00:29 user nova-compute[73450]:     </disk>
Aug 16 17:00:29 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:00:29 user nova-compute[73450]:       <mac address="fa:16:3e:21:1e:98"/>
Aug 16 17:00:29 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:00:29 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:00:29 user nova-compute[73450]:       <target dev="tap222466b9-10"/>
Aug 16 17:00:29 user nova-compute[73450]:     </interface>
Aug 16 17:00:29 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:00:29 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/d2e7d814-bd0b-45f6-b1e4-59e24398fa95/console.log" append="off"/>
Aug 16 17:00:29 user nova-compute[73450]:     </serial>
Aug 16 17:00:29 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:00:29 user nova-compute[73450]:     <video>
Aug 16 17:00:29 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:00:29 user nova-compute[73450]:     </video>
Aug 16 17:00:29 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:00:29 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:00:29 user nova-compute[73450]:     </rng>
Aug 16 17:00:29 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:00:29 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:00:29 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:00:29 user nova-compute[73450]:     </memballoon>
Aug 16 17:00:29 user nova-compute[73450]:   </devices>
Aug 16 17:00:29 user nova-compute[73450]: </domain>
Aug 16 17:00:29 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1685193865',display_name='tempest-TestVolumeBootPattern-server-1685193865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1685193865',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-15hhtq4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:00:16Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=d2e7d814-bd0b-45f6-b1e4-59e24398fa95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG os_vif [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap222466b9-10, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap222466b9-10, col_values=(('external_ids', {'iface-id': '222466b9-1077-4286-a384-e20478d68c1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:1e:98', 'vm-uuid': 'd2e7d814-bd0b-45f6-b1e4-59e24398fa95'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:29 user nova-compute[73450]: INFO os_vif [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10')
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:00:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No VIF found with MAC fa:16:3e:21:1e:98, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-eb936050-849e-429e-a012-ad5990623c13 req-59128ed4-1465-4ff3-81f7-2308ea1e26f1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-eb936050-849e-429e-a012-ad5990623c13 req-59128ed4-1465-4ff3-81f7-2308ea1e26f1 service nova] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-eb936050-849e-429e-a012-ad5990623c13 req-59128ed4-1465-4ff3-81f7-2308ea1e26f1 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-eb936050-849e-429e-a012-ad5990623c13 req-59128ed4-1465-4ff3-81f7-2308ea1e26f1 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-eb936050-849e-429e-a012-ad5990623c13 req-59128ed4-1465-4ff3-81f7-2308ea1e26f1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] No waiting events found dispatching network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:30 user nova-compute[73450]: WARNING nova.compute.manager [req-eb936050-849e-429e-a012-ad5990623c13 req-59128ed4-1465-4ff3-81f7-2308ea1e26f1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received unexpected event network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a for instance with vm_state building and task_state spawning.
Aug 16 17:00:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205232.7313921, d2e7d814-bd0b-45f6-b1e4-59e24398fa95 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] VM Resumed (Lifecycle Event)
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Instance spawned successfully.
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205232.7325737, d2e7d814-bd0b-45f6-b1e4-59e24398fa95 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] VM Started (Lifecycle Event)
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 16 17:00:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:00:32 user nova-compute[73450]: INFO nova.compute.manager [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Took 17.17 seconds to build instance.
Aug 16 17:00:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cfb10dcd-c025-41ed-a249-f7b44a21a899 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.270s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-43bc7b8d-0980-430d-8e8a-1bc3bdf80254 req-7c06af00-8d39-425f-acc2-3fbb520dd2c4 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-43bc7b8d-0980-430d-8e8a-1bc3bdf80254 req-7c06af00-8d39-425f-acc2-3fbb520dd2c4 service nova] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-43bc7b8d-0980-430d-8e8a-1bc3bdf80254 req-7c06af00-8d39-425f-acc2-3fbb520dd2c4 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-43bc7b8d-0980-430d-8e8a-1bc3bdf80254 req-7c06af00-8d39-425f-acc2-3fbb520dd2c4 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-43bc7b8d-0980-430d-8e8a-1bc3bdf80254 req-7c06af00-8d39-425f-acc2-3fbb520dd2c4 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] No waiting events found dispatching network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:33 user nova-compute[73450]: WARNING nova.compute.manager [req-43bc7b8d-0980-430d-8e8a-1bc3bdf80254 req-7c06af00-8d39-425f-acc2-3fbb520dd2c4 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received unexpected event network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a for instance with vm_state active and task_state None.
Aug 16 17:00:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:36 user nova-compute[73450]: INFO nova.compute.manager [None req-cfbd79e1-a0cf-477b-b00f-8303b1f249e2 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Get console output
Aug 16 17:00:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:37 user nova-compute[73450]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 17:00:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:00:42 user nova-compute[73450]: INFO nova.compute.claims [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Claim successful on node user
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.network.neutron [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:00:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.policy [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e23eb33a56994696b7295fdfd0d04cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c0497e2014ad6a8b92a44097f4fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:00:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Creating image(s)
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "/opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.198s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk 1073741824" returned: 0 in 0.072s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Successfully created port: 24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Cannot resize image /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'migration_context' on Instance uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Ensure instance console log exists: /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Successfully updated port: 24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquired lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-changed-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.compute.manager [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Refreshing instance network info cache due to event network-changed-24ac7cff-6cf8-410f-87e1-aef0895ad5b1. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] Acquiring lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updating instance_info_cache with network_info: [{"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Releasing lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Instance network_info: |[{"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] Acquired lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.neutron [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Refreshing network info cache for port 24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Start _get_guest_xml network_info=[{"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:00:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:00:44 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247374528',display_name='tempest-AttachVolumeNegativeTest-server-1247374528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247374528',id=42,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXq7wRySKTQM9oErd3M+XhdUcSOuFL3Kw0FQ4d/lWMCY3tBP9mmU3Cyy4L3K0ZDEVJoWBLrAcnsvZEaI7LvFVf15ubiidyOfNNAYxxo6Itzb61vAIaxktqLJgFqWdV3aA==',key_name='tempest-keypair-1443295644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-vt0x9d8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=52a40134-ade0-4c24-9f7d-7840b9fb8593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'pci_devices' on Instance uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:00:44 user nova-compute[73450]:   <uuid>52a40134-ade0-4c24-9f7d-7840b9fb8593</uuid>
Aug 16 17:00:44 user nova-compute[73450]:   <name>instance-0000002a</name>
Aug 16 17:00:44 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:00:44 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:00:44 user nova-compute[73450]:   <metadata>
Aug 16 17:00:44 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:00:44 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:00:44 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1247374528</nova:name>
Aug 16 17:00:44 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:00:44</nova:creationTime>
Aug 16 17:00:44 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:00:44 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:00:44 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:00:44 user nova-compute[73450]:       <nova:owner>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:user uuid="e23eb33a56994696b7295fdfd0d04cac">tempest-AttachVolumeNegativeTest-1594829227-project-member</nova:user>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:project uuid="9b7c0497e2014ad6a8b92a44097f4fb7">tempest-AttachVolumeNegativeTest-1594829227</nova:project>
Aug 16 17:00:44 user nova-compute[73450]:       </nova:owner>
Aug 16 17:00:44 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:00:44 user nova-compute[73450]:       <nova:ports>
Aug 16 17:00:44 user nova-compute[73450]:         <nova:port uuid="24ac7cff-6cf8-410f-87e1-aef0895ad5b1">
Aug 16 17:00:44 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 17:00:44 user nova-compute[73450]:         </nova:port>
Aug 16 17:00:44 user nova-compute[73450]:       </nova:ports>
Aug 16 17:00:44 user nova-compute[73450]:     </nova:instance>
Aug 16 17:00:44 user nova-compute[73450]:   </metadata>
Aug 16 17:00:44 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:00:44 user nova-compute[73450]:     <system>
Aug 16 17:00:44 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:00:44 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:00:44 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:00:44 user nova-compute[73450]:       <entry name="serial">52a40134-ade0-4c24-9f7d-7840b9fb8593</entry>
Aug 16 17:00:44 user nova-compute[73450]:       <entry name="uuid">52a40134-ade0-4c24-9f7d-7840b9fb8593</entry>
Aug 16 17:00:44 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:00:44 user nova-compute[73450]:     </system>
Aug 16 17:00:44 user nova-compute[73450]:   </sysinfo>
Aug 16 17:00:44 user nova-compute[73450]:   <os>
Aug 16 17:00:44 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:00:44 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:00:44 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:00:44 user nova-compute[73450]:   </os>
Aug 16 17:00:44 user nova-compute[73450]:   <features>
Aug 16 17:00:44 user nova-compute[73450]:     <acpi/>
Aug 16 17:00:44 user nova-compute[73450]:     <apic/>
Aug 16 17:00:44 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:00:44 user nova-compute[73450]:   </features>
Aug 16 17:00:44 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:00:44 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:00:44 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:00:44 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:00:44 user nova-compute[73450]:   </clock>
Aug 16 17:00:44 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:00:44 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:00:44 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:00:44 user nova-compute[73450]:   </cpu>
Aug 16 17:00:44 user nova-compute[73450]:   <devices>
Aug 16 17:00:44 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:00:44 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:00:44 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk"/>
Aug 16 17:00:44 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:00:44 user nova-compute[73450]:     </disk>
Aug 16 17:00:44 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:00:44 user nova-compute[73450]:       <mac address="fa:16:3e:c7:1c:d5"/>
Aug 16 17:00:44 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:00:44 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:00:44 user nova-compute[73450]:       <target dev="tap24ac7cff-6c"/>
Aug 16 17:00:44 user nova-compute[73450]:     </interface>
Aug 16 17:00:44 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:00:44 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/console.log" append="off"/>
Aug 16 17:00:44 user nova-compute[73450]:     </serial>
Aug 16 17:00:44 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:00:44 user nova-compute[73450]:     <video>
Aug 16 17:00:44 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:00:44 user nova-compute[73450]:     </video>
Aug 16 17:00:44 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:00:44 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:00:44 user nova-compute[73450]:     </rng>
Aug 16 17:00:44 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:00:44 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:00:44 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:00:44 user nova-compute[73450]:     </memballoon>
Aug 16 17:00:44 user nova-compute[73450]:   </devices>
Aug 16 17:00:44 user nova-compute[73450]: </domain>
Aug 16 17:00:44 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247374528',display_name='tempest-AttachVolumeNegativeTest-server-1247374528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247374528',id=42,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXq7wRySKTQM9oErd3M+XhdUcSOuFL3Kw0FQ4d/lWMCY3tBP9mmU3Cyy4L3K0ZDEVJoWBLrAcnsvZEaI7LvFVf15ubiidyOfNNAYxxo6Itzb61vAIaxktqLJgFqWdV3aA==',key_name='tempest-keypair-1443295644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-vt0x9d8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=52a40134-ade0-4c24-9f7d-7840b9fb8593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG os_vif [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24ac7cff-6c, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24ac7cff-6c, col_values=(('external_ids', {'iface-id': '24ac7cff-6cf8-410f-87e1-aef0895ad5b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:1c:d5', 'vm-uuid': '52a40134-ade0-4c24-9f7d-7840b9fb8593'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:00:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:44 user nova-compute[73450]: INFO os_vif [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c')
Aug 16 17:00:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:00:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:c7:1c:d5, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:00:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updated VIF entry in instance network info cache for port 24ac7cff-6cf8-410f-87e1-aef0895ad5b1. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:00:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updating instance_info_cache with network_info: [{"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:00:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7cd77302-15e6-449d-9903-dd267edf96c8 req-57e22b4b-75ae-497b-ab78-82ab92b3f7f6 service nova] Releasing lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac7792f9-ffcf-4c4b-8f44-f635c3ea3d95 req-f10ccd0e-a4bb-4bbd-9d46-cfc920d61cb4 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac7792f9-ffcf-4c4b-8f44-f635c3ea3d95 req-f10ccd0e-a4bb-4bbd-9d46-cfc920d61cb4 service nova] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac7792f9-ffcf-4c4b-8f44-f635c3ea3d95 req-f10ccd0e-a4bb-4bbd-9d46-cfc920d61cb4 service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ac7792f9-ffcf-4c4b-8f44-f635c3ea3d95 req-f10ccd0e-a4bb-4bbd-9d46-cfc920d61cb4 service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-ac7792f9-ffcf-4c4b-8f44-f635c3ea3d95 req-f10ccd0e-a4bb-4bbd-9d46-cfc920d61cb4 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] No waiting events found dispatching network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:46 user nova-compute[73450]: WARNING nova.compute.manager [req-ac7792f9-ffcf-4c4b-8f44-f635c3ea3d95 req-f10ccd0e-a4bb-4bbd-9d46-cfc920d61cb4 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received unexpected event network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 for instance with vm_state building and task_state spawning.
Aug 16 17:00:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-b57b078e-a395-4f47-8ca9-46de464df7e1 req-efc0c20a-f170-43b4-837e-33f905e1f807 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b57b078e-a395-4f47-8ca9-46de464df7e1 req-efc0c20a-f170-43b4-837e-33f905e1f807 service nova] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b57b078e-a395-4f47-8ca9-46de464df7e1 req-efc0c20a-f170-43b4-837e-33f905e1f807 service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b57b078e-a395-4f47-8ca9-46de464df7e1 req-efc0c20a-f170-43b4-837e-33f905e1f807 service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-b57b078e-a395-4f47-8ca9-46de464df7e1 req-efc0c20a-f170-43b4-837e-33f905e1f807 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] No waiting events found dispatching network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:00:48 user nova-compute[73450]: WARNING nova.compute.manager [req-b57b078e-a395-4f47-8ca9-46de464df7e1 req-efc0c20a-f170-43b4-837e-33f905e1f807 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received unexpected event network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 for instance with vm_state building and task_state spawning.
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205248.7259398, 52a40134-ade0-4c24-9f7d-7840b9fb8593 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] VM Resumed (Lifecycle Event)
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Instance spawned successfully.
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205248.7283282, 52a40134-ade0-4c24-9f7d-7840b9fb8593 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] VM Started (Lifecycle Event)
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 16 17:00:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:00:48 user nova-compute[73450]: INFO nova.compute.manager [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Took 6.77 seconds to build instance.
Aug 16 17:00:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-50c2cb9a-1bf4-49c2-94d3-d25fa0693d6e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.908s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:00:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [{"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-5df06efe-b1d6-470e-a230-bf63734642f5" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:00:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:00:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:00:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:00 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:01:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:01:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=23.81250762939453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5df06efe-b1d6-470e-a230-bf63734642f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1ab08e1c-6772-4081-b995-61c8d0b19057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d2e7d814-bd0b-45f6-b1e4-59e24398fa95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-changed-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Refreshing instance network info cache due to event network-changed-74f25aaa-9274-4f83-8219-9e5f71443752. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] Acquiring lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] Acquired lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.network.neutron [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Refreshing network info cache for port 74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:01:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updated VIF entry in instance network info cache for port 74f25aaa-9274-4f83-8219-9e5f71443752. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG nova.network.neutron [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updating instance_info_cache with network_info: [{"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-05855a2b-f4e0-44e2-838f-a781b3d211e3 req-4411c658-4f61-4d7c-8c98-7ca02ba22e55 service nova] Releasing lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:01:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'flavor' on Instance uuid 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:05 user nova-compute[73450]: INFO nova.compute.manager [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Attaching volume 633d75eb-352c-4449-89bd-5243e83f2232 to /dev/vdb
Aug 16 17:01:05 user nova-compute[73450]: DEBUG os_brick.utils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af42640b-c14e-455c-a4f3-0d52090a6854]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c1723c-5edb-435c-86e1-807adf4b345f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4500ecec-4c3d-4398-9398-6b516386b507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9d4e0f-4ce4-4df6-98ec-1398eb1d385a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:01:05 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:01:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c204d1f-8aee-4ea5-8522-276855469f83]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG os_brick.utils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:01:05 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updating existing volume attachment record: a629c49c-a340-4888-8c28-cac326e4970d {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:01:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:01:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyKPLwsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:01:16 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:01:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:01:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:01:16 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:01:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:01:16 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:01:16 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:01:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[479391e0-6a05-4df1-9fc1-fec264cafc72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:01:17 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c397ded-3c1f-47b5-abf8-3029f841cf56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232] added
Aug 16 17:01:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443eb52-3e46-4011-a7a9-797ffe6a3f18]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e0413b-a8ea-4263-8362-7574ab5a968a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyKPLwsF {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyKPLwsF" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed3dbf0-a57f-4bf4-aa80-118b542ad2ae]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyKPLwsF'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f01311f-cfb7-41a7-9a3b-88123ab61a4f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704e3b0-a055-4001-a5d8-6e6fba53997d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc901ffc-f6c1-4438-af71-562a1b482bf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260]
Aug 16 17:01:17 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260] successful.
Aug 16 17:01:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d51ddd7-fd9a-4bff-ba25-8b3b18be3b23]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[68156303-6d46-476f-b0bb-7c58aff470f6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:17 user nova-compute[73450]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 (non-flash)
Aug 16 17:01:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf85a70-875a-4991-b264-4e2af2a8ce47]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:01:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyKPLwsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26461666366303866', 'path': '/dev/sde'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461666366303866', 'path': '/dev/sde'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'flavor' on Instance uuid 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:01:18 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:01:18 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 17:01:18 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:01:18 user nova-compute[73450]:   <serial>633d75eb-352c-4449-89bd-5243e83f2232</serial>
Aug 16 17:01:18 user nova-compute[73450]: </disk>
Aug 16 17:01:18 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:01:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] No VIF found with MAC fa:16:3e:fd:7e:86, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:01:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d94d129d-d118-46ac-8b14-c1367c6ac002 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.727s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:20 user nova-compute[73450]: INFO nova.compute.manager [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Detaching volume 633d75eb-352c-4449-89bd-5243e83f2232
Aug 16 17:01:20 user nova-compute[73450]: INFO nova.virt.block_device [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Attempting to driver detach volume 633d75eb-352c-4449-89bd-5243e83f2232 from mountpoint /dev/vdb
Aug 16 17:01:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Attempting to detach device vdb from instance 1ab08e1c-6772-4081-b995-61c8d0b19057 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:01:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:01:20 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:01:20 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 17:01:20 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:01:20 user nova-compute[73450]:   <serial>633d75eb-352c-4449-89bd-5243e83f2232</serial>
Aug 16 17:01:20 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:01:20 user nova-compute[73450]: </disk>
Aug 16 17:01:20 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:01:20 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully detached device vdb from instance 1ab08e1c-6772-4081-b995-61c8d0b19057 from the persistent domain config.
Aug 16 17:01:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ab08e1c-6772-4081-b995-61c8d0b19057 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:01:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:01:20 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:01:20 user nova-compute[73450]:   <source dev="/dev/sde"/>
Aug 16 17:01:20 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:01:20 user nova-compute[73450]:   <serial>633d75eb-352c-4449-89bd-5243e83f2232</serial>
Aug 16 17:01:20 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:01:20 user nova-compute[73450]: </disk>
Aug 16 17:01:20 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205281.3261986, 1ab08e1c-6772-4081-b995-61c8d0b19057 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:01:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully detached device vdb from instance 1ab08e1c-6772-4081-b995-61c8d0b19057 from the live domain config.
Aug 16 17:01:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyKPLwsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:01:21 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[25560732-edf3-40cf-95d1-ce2c1e77d392]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d510c-1e63-453d-a786-1b3204ee1d98]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:21 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:21 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:21 user nova-compute[73450]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 (non-flash)
Aug 16 17:01:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:21 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:21 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:21 user nova-compute[73450]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 (non-flash)
Aug 16 17:01:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe27076c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232'): ({'sde'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Removing single pathed devices sde {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[985c7378-5709-471d-9c4c-6387e558d73f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e57de18-c761-4b56-99e5-e2e302dcf30b]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Flushing IO for device /dev/sde {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc316f-c551-4971-a939-7903fb0d01cd]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[110b59d2-de3c-427b-9775-ec53ae3d632b]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] SCSI volumes sde have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55e857b-c1b3-4edc-b9eb-967d17de0de9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb465a-7bf0-4ab9-b81b-75f80ab6bd2d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260]
Aug 16 17:01:21 user nova-compute[73450]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232, portal: 172.16.0.220,3260] successful.
Aug 16 17:01:21 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:633d75eb-352c-4449-89bd-5243e83f2232 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12107b5c-22a4-4382-b675-d6e75f3a5cc1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] <== disconnect_volume: return (318ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:01:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:01:22 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'flavor' on Instance uuid 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:01:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d6dded20-66be-407e-bc08-61889c637e52 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:37 user nova-compute[73450]: INFO nova.compute.manager [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Terminating instance
Aug 16 17:01:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-f0963b30-652f-4182-845f-de6b351ce1a2 req-c5c6b3a9-584b-4087-97fe-d8d52f48e05f service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-unplugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f0963b30-652f-4182-845f-de6b351ce1a2 req-c5c6b3a9-584b-4087-97fe-d8d52f48e05f service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f0963b30-652f-4182-845f-de6b351ce1a2 req-c5c6b3a9-584b-4087-97fe-d8d52f48e05f service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f0963b30-652f-4182-845f-de6b351ce1a2 req-c5c6b3a9-584b-4087-97fe-d8d52f48e05f service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-f0963b30-652f-4182-845f-de6b351ce1a2 req-c5c6b3a9-584b-4087-97fe-d8d52f48e05f service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-unplugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-f0963b30-652f-4182-845f-de6b351ce1a2 req-c5c6b3a9-584b-4087-97fe-d8d52f48e05f service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-unplugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:38 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Instance destroyed successfully.
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'resources' on Instance uuid 5df06efe-b1d6-470e-a230-bf63734642f5 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1646450735',display_name='tempest-ServerActionsTestOtherA-server-1646450735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1646450735',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:57:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-60302x42',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=5df06efe-b1d6-470e-a230-bf63734642f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "c5752bbb-fe02-446e-a096-3d0388da13be", "address": "fa:16:3e:52:80:be", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5752bbb-fe", "ovs_interfaceid": "c5752bbb-fe02-446e-a096-3d0388da13be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_vif [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5752bbb-fe, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:01:38 user nova-compute[73450]: INFO os_vif [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:be,bridge_name='br-int',has_traffic_filtering=True,id=c5752bbb-fe02-446e-a096-3d0388da13be,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5752bbb-fe')
Aug 16 17:01:38 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpzDWPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:01:38 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3578003-6397-4693-a949-c4eadfcb2054]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51f9d8-ed23-49e8-a389-9a27aeb3dc72]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:38 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:38 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:38 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 (non-flash)
Aug 16 17:01:38 user nova-compute[73450]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:38 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:38 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe250719ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034f97e-4081-466f-82cb-0d2356d1b14e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c2dd5b-3388-4a41-a9ac-a89d24413032]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed9d7dc-65c1-4ffc-94a6-55ee5e88dc59]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:01:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.083s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e11463-fb37-43e4-89ed-4028c4ebfed4]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[99abc567-2897-4b1b-b468-50ef2ce200b5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52fc29a-4398-4ed2-a659-11dcdbe7e9b7]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260]
Aug 16 17:01:39 user nova-compute[73450]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2, portal: 172.16.0.220,3260] successful.
Aug 16 17:01:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79994e09-5f3c-465f-a16c-0c798b6b01b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a97b1-54e2-4374-89d7-48795b9700a7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] <== disconnect_volume: return (356ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:01:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Deleting instance files /opt/stack/data/nova/instances/5df06efe-b1d6-470e-a230-bf63734642f5_del
Aug 16 17:01:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Deletion of /opt/stack/data/nova/instances/5df06efe-b1d6-470e-a230-bf63734642f5_del complete
Aug 16 17:01:39 user nova-compute[73450]: INFO nova.compute.manager [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 16 17:01:39 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:01:39 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:01:40 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:01:40 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Took 1.32 seconds to deallocate network for instance.
Aug 16 17:01:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-3c177bae-ef49-4cbb-b37c-00565f27604d req-076bf23f-e89d-41e6-af8e-a022ff6d8b72 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:01:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3c177bae-ef49-4cbb-b37c-00565f27604d req-076bf23f-e89d-41e6-af8e-a022ff6d8b72 service nova] Acquiring lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3c177bae-ef49-4cbb-b37c-00565f27604d req-076bf23f-e89d-41e6-af8e-a022ff6d8b72 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3c177bae-ef49-4cbb-b37c-00565f27604d req-076bf23f-e89d-41e6-af8e-a022ff6d8b72 service nova] Lock "5df06efe-b1d6-470e-a230-bf63734642f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-3c177bae-ef49-4cbb-b37c-00565f27604d req-076bf23f-e89d-41e6-af8e-a022ff6d8b72 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] No waiting events found dispatching network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:01:40 user nova-compute[73450]: WARNING nova.compute.manager [req-3c177bae-ef49-4cbb-b37c-00565f27604d req-076bf23f-e89d-41e6-af8e-a022ff6d8b72 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received unexpected event network-vif-plugged-c5752bbb-fe02-446e-a096-3d0388da13be for instance with vm_state active and task_state deleting.
Aug 16 17:01:41 user nova-compute[73450]: INFO nova.compute.manager [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Took 0.86 seconds to detach 1 volumes for instance.
Aug 16 17:01:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Deleting volume: 79994e09-5f3c-465f-a16c-0c798b6b01b2 {{(pid=73450) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 17:01:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:41 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:01:41 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:01:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:41 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Deleted allocations for instance 5df06efe-b1d6-470e-a230-bf63734642f5
Aug 16 17:01:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-88060c88-18dd-427f-8ea0-0b51286f4f83 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "5df06efe-b1d6-470e-a230-bf63734642f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.246s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:42 user nova-compute[73450]: DEBUG nova.compute.manager [req-7a0956db-d0c5-4570-a588-c58872a8e398 req-8cd9370d-440f-45b3-b5bf-41735ddfd595 service nova] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Received event network-vif-deleted-c5752bbb-fe02-446e-a096-3d0388da13be {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:01:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:01:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing instance network info cache due to event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:01:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:01:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:01:47 user nova-compute[73450]: DEBUG nova.network.neutron [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updated VIF entry in instance network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-301ad80b-0a6a-4b5d-b51b-9d601ab36e87 req-59a7e4cf-bbf2-46bb-b917-22aa8dd50c93 service nova] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:01:48 user nova-compute[73450]: INFO nova.compute.manager [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Detaching volume b1f30b0d-d0db-408b-b35d-24b447e44160
Aug 16 17:01:48 user nova-compute[73450]: INFO nova.virt.block_device [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Attempting to driver detach volume b1f30b0d-d0db-408b-b35d-24b447e44160 from mountpoint /dev/vdb
Aug 16 17:01:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Attempting to detach device vdb from instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:01:48 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:01:48 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:01:48 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:01:48 user nova-compute[73450]:   <serial>b1f30b0d-d0db-408b-b35d-24b447e44160</serial>
Aug 16 17:01:48 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:01:48 user nova-compute[73450]: </disk>
Aug 16 17:01:48 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:01:48 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully detached device vdb from instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a from the persistent domain config.
Aug 16 17:01:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:01:48 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:01:48 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:01:48 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:01:48 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:01:48 user nova-compute[73450]:   <serial>b1f30b0d-d0db-408b-b35d-24b447e44160</serial>
Aug 16 17:01:48 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:01:48 user nova-compute[73450]: </disk>
Aug 16 17:01:48 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205309.4171994, 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:01:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully detached device vdb from instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a from the live domain config.
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFRZeNwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:01:49 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d0998-a13b-41cf-886c-b85302b9215b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e8ac2-4c5d-4b89-96dd-f2dc90ed3096]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:49 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 (non-flash)
Aug 16 17:01:49 user nova-compute[73450]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:01:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2507b7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9dba8f-b43e-4f35-a093-52218984b84c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea25ec9-cab9-4209-b99f-8bca9728badf]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[66419559-f209-4154-955d-5580149d4422]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea00a4e5-d5df-4e9e-bc4c-d7a7e036cdd7]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4370a17-27b3-4ca3-8c29-70611600019c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be27c5-4ab6-4dbe-a228-8e851845ed20]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260]
Aug 16 17:01:49 user nova-compute[73450]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160, portal: 172.16.0.220,3260] successful.
Aug 16 17:01:49 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f30b0d-d0db-408b-b35d-24b447e44160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b666be-2bb7-4202-b450-9c5c93214cbe]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] <== disconnect_volume: return (305ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing instance network info cache due to event network-changed-045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] Acquiring lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] Acquired lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:01:49 user nova-compute[73450]: DEBUG nova.network.neutron [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Refreshing network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:01:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updated VIF entry in instance network info cache for port 045dc6da-e423-458f-b666-25bbb02f3e50. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:01:50 user nova-compute[73450]: DEBUG nova.network.neutron [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [{"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:01:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-1285b925-9c0f-44ff-a8b3-3e3b2dfdbabc req-a5c5cd71-717f-4a87-b0f7-9227afc2bab5 service nova] Releasing lock "refresh_cache-353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:01:50 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'flavor' on Instance uuid 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:01:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7a1cc3e9-4eb9-4f4f-9df5-b5554ea6b6df tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:01:53 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205298.7740507, 5df06efe-b1d6-470e-a230-bf63734642f5 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:01:53 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] VM Stopped (Lifecycle Event)
Aug 16 17:01:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-134adbb5-70f1-479a-9a0f-b5f6fea0ede4 None None] [instance: 5df06efe-b1d6-470e-a230-bf63734642f5] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:01:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating instance_info_cache with network_info: [{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:01:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:01:58 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:01:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:01 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:02:04 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:02:04 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=7945MB free_disk=23.763935089111328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance eed98e2e-e225-483c-93bf-b8100e2bc5fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 1ab08e1c-6772-4081-b995-61c8d0b19057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d2e7d814-bd0b-45f6-b1e4-59e24398fa95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:02:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:02:05 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:02:05 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:02:05 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:02:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-changed-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Refreshing instance network info cache due to event network-changed-222466b9-1077-4286-a384-e20478d68c1a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] Acquiring lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] Acquired lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Refreshing network info cache for port 222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:02:08 user nova-compute[73450]: DEBUG nova.network.neutron [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updated VIF entry in instance network info cache for port 222466b9-1077-4286-a384-e20478d68c1a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:02:08 user nova-compute[73450]: DEBUG nova.network.neutron [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating instance_info_cache with network_info: [{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7c901d70-3681-405a-b3c4-fdf098ae4145 req-305c3b71-3a67-4523-b447-be3d43d80e39 service nova] Releasing lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:02:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-changed-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:11 user nova-compute[73450]: DEBUG nova.compute.manager [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Refreshing instance network info cache due to event network-changed-74f25aaa-9274-4f83-8219-9e5f71443752. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:02:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] Acquiring lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] Acquired lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:11 user nova-compute[73450]: DEBUG nova.network.neutron [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Refreshing network info cache for port 74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:12 user nova-compute[73450]: INFO nova.compute.manager [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Terminating instance
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.network.neutron [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updated VIF entry in instance network info cache for port 74f25aaa-9274-4f83-8219-9e5f71443752. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.network.neutron [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updating instance_info_cache with network_info: [{"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-bfa137e8-dd88-4d76-bc8f-c57796a464d6 req-c9a928ec-c6c4-4024-9503-d8df796f91cb service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-vif-unplugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bfa137e8-dd88-4d76-bc8f-c57796a464d6 req-c9a928ec-c6c4-4024-9503-d8df796f91cb service nova] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bfa137e8-dd88-4d76-bc8f-c57796a464d6 req-c9a928ec-c6c4-4024-9503-d8df796f91cb service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bfa137e8-dd88-4d76-bc8f-c57796a464d6 req-c9a928ec-c6c4-4024-9503-d8df796f91cb service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-bfa137e8-dd88-4d76-bc8f-c57796a464d6 req-c9a928ec-c6c4-4024-9503-d8df796f91cb service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] No waiting events found dispatching network-vif-unplugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.compute.manager [req-bfa137e8-dd88-4d76-bc8f-c57796a464d6 req-c9a928ec-c6c4-4024-9503-d8df796f91cb service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-vif-unplugged-74f25aaa-9274-4f83-8219-9e5f71443752 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6e9644c2-f381-4255-8edc-c3c234e5c254 req-90118dc4-0688-4a14-9d75-680f72aefc98 service nova] Releasing lock "refresh_cache-1ab08e1c-6772-4081-b995-61c8d0b19057" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:02:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Instance destroyed successfully.
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'resources' on Instance uuid 1ab08e1c-6772-4081-b995-61c8d0b19057 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-612633402',display_name='tempest-TestStampPattern-server-612633402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-612633402',id=40,image_ref='1533d565-34f5-4f74-9df8-fb360c97c65f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYwZqnqg7dO+ytxFjz6XdBi4yIzNz/7UrcYmlm0Yp3fzTPnQGAJvVEeoFigebR3Ay8FkG/g2G8In8fH/us7360kHsj5Ihla9q+Tr8gMmAHGnvFblbO8Eikw5YPaOPmJg==',key_name='tempest-TestStampPattern-481591227',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33ace27d486848e4a6ae14949629da11',ramdisk_id='',reservation_id='r-uo5d6bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b1da2b30-72cd-46f8-8620-d8c044e79c96',image_min_disk='1',image_min_ram='0',image_owner_id='33ace27d486848e4a6ae14949629da11',image_owner_project_name='tempest-TestStampPattern-1739750355',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1739750355-project-member',image_user_id='3204a7c592ff4585be593753006fd5bb',owner_project_name='tempest-TestStampPattern-1739750355',owner_user_name='tempest-TestStampPattern-1739750355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:59:20Z,user_data=None,user_id='3204a7c592ff4585be593753006fd5bb',uuid=1ab08e1c-6772-4081-b995-61c8d0b19057,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converting VIF {"id": "74f25aaa-9274-4f83-8219-9e5f71443752", "address": "fa:16:3e:fd:7e:86", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f25aaa-92", "ovs_interfaceid": "74f25aaa-9274-4f83-8219-9e5f71443752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG os_vif [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74f25aaa-92, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:12 user nova-compute[73450]: INFO os_vif [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=74f25aaa-9274-4f83-8219-9e5f71443752,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f25aaa-92')
Aug 16 17:02:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Deleting instance files /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057_del
Aug 16 17:02:12 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Deletion of /opt/stack/data/nova/instances/1ab08e1c-6772-4081-b995-61c8d0b19057_del complete
Aug 16 17:02:12 user nova-compute[73450]: INFO nova.compute.manager [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 17:02:12 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:02:12 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:02:13 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:13 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Took 0.71 seconds to deallocate network for instance.
Aug 16 17:02:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-346fb385-a43b-426a-aa39-512f89162884 req-c9e19cf4-2f44-4c1d-9e1e-87a06867c219 service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-vif-deleted-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:14 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:02:14 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:02:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:14 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Deleted allocations for instance 1ab08e1c-6772-4081-b995-61c8d0b19057
Aug 16 17:02:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-178b6bed-ca6e-4b8b-bc73-8f41388dd2e2 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-6912d8c5-16a4-43f7-826e-0946e5817e85 req-f0ba2799-fdc8-4a0a-8a8c-650d03bd273d service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received event network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6912d8c5-16a4-43f7-826e-0946e5817e85 req-f0ba2799-fdc8-4a0a-8a8c-650d03bd273d service nova] Acquiring lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6912d8c5-16a4-43f7-826e-0946e5817e85 req-f0ba2799-fdc8-4a0a-8a8c-650d03bd273d service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6912d8c5-16a4-43f7-826e-0946e5817e85 req-f0ba2799-fdc8-4a0a-8a8c-650d03bd273d service nova] Lock "1ab08e1c-6772-4081-b995-61c8d0b19057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-6912d8c5-16a4-43f7-826e-0946e5817e85 req-f0ba2799-fdc8-4a0a-8a8c-650d03bd273d service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] No waiting events found dispatching network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:15 user nova-compute[73450]: WARNING nova.compute.manager [req-6912d8c5-16a4-43f7-826e-0946e5817e85 req-f0ba2799-fdc8-4a0a-8a8c-650d03bd273d service nova] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Received unexpected event network-vif-plugged-74f25aaa-9274-4f83-8219-9e5f71443752 for instance with vm_state deleted and task_state None.
Aug 16 17:02:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:27 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205332.829402, 1ab08e1c-6772-4081-b995-61c8d0b19057 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:02:27 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] VM Stopped (Lifecycle Event)
Aug 16 17:02:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fa0c7c55-4b03-4125-8f7c-ccfc8536007b None None] [instance: 1ab08e1c-6772-4081-b995-61c8d0b19057] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:02:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-changed-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Refreshing instance network info cache due to event network-changed-24ac7cff-6cf8-410f-87e1-aef0895ad5b1. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] Acquiring lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] Acquired lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Refreshing network info cache for port 24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updated VIF entry in instance network info cache for port 24ac7cff-6cf8-410f-87e1-aef0895ad5b1. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updating instance_info_cache with network_info: [{"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-668f3351-be5e-49e6-93dd-23c333730762 req-2c00466f-19e9-4da7-bbfc-3f027c2e19f3 service nova] Releasing lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:02:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:38 user nova-compute[73450]: INFO nova.compute.manager [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Attaching volume 63c35cd8-3660-45b7-bd16-813de59662cb to /dev/vdb
Aug 16 17:02:38 user nova-compute[73450]: DEBUG os_brick.utils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0da0d5-f3a7-46a5-95ba-7b80987f3b46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d61834-6618-43f0-89ad-e090a3347242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3f00c-5d5c-4702-a4d1-327c16a9861e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f843672-180f-4e9b-9f0b-31f7ad2fe303]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:02:38 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:02:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44514668-5c41-428d-97e2-09e64ff2a4a8]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG os_brick.utils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updating existing volume attachment record: 5f57d1d7-b78c-4d94-b53e-00387081bd8c {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:02:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:41 user nova-compute[73450]: INFO nova.compute.manager [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Terminating instance
Aug 16 17:02:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:02:41 user nova-compute[73450]: INFO nova.compute.claims [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Claim successful on node user
Aug 16 17:02:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f5244f1d-1b4c-4f60-9df5-414f795e2d65 req-6cadff99-588b-4b6c-9282-f0b67e2e71e7 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-vif-unplugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f5244f1d-1b4c-4f60-9df5-414f795e2d65 req-6cadff99-588b-4b6c-9282-f0b67e2e71e7 service nova] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f5244f1d-1b4c-4f60-9df5-414f795e2d65 req-6cadff99-588b-4b6c-9282-f0b67e2e71e7 service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f5244f1d-1b4c-4f60-9df5-414f795e2d65 req-6cadff99-588b-4b6c-9282-f0b67e2e71e7 service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f5244f1d-1b4c-4f60-9df5-414f795e2d65 req-6cadff99-588b-4b6c-9282-f0b67e2e71e7 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] No waiting events found dispatching network-vif-unplugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-f5244f1d-1b4c-4f60-9df5-414f795e2d65 req-6cadff99-588b-4b6c-9282-f0b67e2e71e7 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-vif-unplugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:02:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Instance destroyed successfully.
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lazy-loading 'resources' on Instance uuid eed98e2e-e225-483c-93bf-b8100e2bc5fe {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-856970353',display_name='tempest-ServerActionsTestOtherA-server-856970353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-856970353',id=18,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrlhHVkdkOgyCkFVOX02dBOfnIKctRVjX6msM/l5t6gfCqtOxfX9PYX8H0UFijkrAvrWu2sHkQGaj/ZBbZIQMRkJdJ0F19zLLmI+1dOODVU9vw1KbARIpt5xWziXxkwzA==',key_name='tempest-keypair-1693320376',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db72f2fe40fe410098164a19683782d4',ramdisk_id='',reservation_id='r-q059elxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1309270761',owner_user_name='tempest-ServerActionsTestOtherA-1309270761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb44f7411ad47b18d2c58a1dc6ac074',uuid=eed98e2e-e225-483c-93bf-b8100e2bc5fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converting VIF {"id": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "address": "fa:16:3e:06:2f:dc", "network": {"id": "034c5998-8dd2-4d33-9c68-00d65a41b7de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-252477887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db72f2fe40fe410098164a19683782d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40a61-d7", "ovs_interfaceid": "77f40a61-d7ad-4a05-81bc-c24b58ba65f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_vif [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f40a61-d7, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:42 user nova-compute[73450]: INFO os_vif [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2f:dc,bridge_name='br-int',has_traffic_filtering=True,id=77f40a61-d7ad-4a05-81bc-c24b58ba65f6,network=Network(034c5998-8dd2-4d33-9c68-00d65a41b7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40a61-d7')
Aug 16 17:02:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Deleting instance files /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe_del
Aug 16 17:02:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Deletion of /opt/stack/data/nova/instances/eed98e2e-e225-483c-93bf-b8100e2bc5fe_del complete
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:02:42 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:02:42 user nova-compute[73450]: INFO nova.compute.manager [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:02:42 user nova-compute[73450]: INFO nova.virt.block_device [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Booting with volume 28d7b84b-b9ad-4b4a-80eb-80d74b735bbf at /dev/vda
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_brick.utils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae6ed7-2191-44c9-842f-c311dbe25ac8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[738ec2f0-9984-4add-aded-d3b9300346e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389f817-8166-45e5-a82f-e0243a17bdb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac17f621-7b38-4dc5-9700-ab335a782548]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.policy [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c95d246b43b45b4963f9d750ae89fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b953d82d634106aa0fb9574fafdc0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:02:42 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:02:42 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b1554b-4d37-4699-8667-1090e5f73728]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG os_brick.utils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:02:42 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updating existing volume attachment record: 9162d8e6-ca8c-48e3-b05b-f5dd18e90bf3 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:43 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Took 0.76 seconds to deallocate network for instance.
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-3933c068-39e7-4a55-b292-85b6526e6d72 req-6fcb8185-9216-4efe-b324-2b36ba809e8c service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-vif-deleted-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:43 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Deleted allocations for instance eed98e2e-e225-483c-93bf-b8100e2bc5fe
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2d3d468f-3808-47c2-9d6d-6cb79cd206f3 tempest-ServerActionsTestOtherA-1309270761 tempest-ServerActionsTestOtherA-1309270761-project-member] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Successfully created port: bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-0ce76ab4-3f32-40eb-8b5f-fb188dfa6984 req-d9f8e440-74cc-4667-b6e9-8de1dcc6a451 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received event network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ce76ab4-3f32-40eb-8b5f-fb188dfa6984 req-d9f8e440-74cc-4667-b6e9-8de1dcc6a451 service nova] Acquiring lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ce76ab4-3f32-40eb-8b5f-fb188dfa6984 req-d9f8e440-74cc-4667-b6e9-8de1dcc6a451 service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0ce76ab4-3f32-40eb-8b5f-fb188dfa6984 req-d9f8e440-74cc-4667-b6e9-8de1dcc6a451 service nova] Lock "eed98e2e-e225-483c-93bf-b8100e2bc5fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-0ce76ab4-3f32-40eb-8b5f-fb188dfa6984 req-d9f8e440-74cc-4667-b6e9-8de1dcc6a451 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] No waiting events found dispatching network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:43 user nova-compute[73450]: WARNING nova.compute.manager [req-0ce76ab4-3f32-40eb-8b5f-fb188dfa6984 req-d9f8e440-74cc-4667-b6e9-8de1dcc6a451 service nova] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Received unexpected event network-vif-plugged-77f40a61-d7ad-4a05-81bc-c24b58ba65f6 for instance with vm_state deleted and task_state None.
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Successfully updated port: bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquired lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-changed-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Refreshing instance network info cache due to event network-changed-bd74a079-f869-4f99-a657-844139ad272b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] Acquiring lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updating instance_info_cache with network_info: [{"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Releasing lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Instance network_info: |[{"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] Acquired lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Refreshing network info cache for port bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:46 user nova-compute[73450]: INFO nova.compute.manager [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Terminating instance
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updated VIF entry in instance network info cache for port bd74a079-f869-4f99-a657-844139ad272b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updating instance_info_cache with network_info: [{"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-62ff1ece-7aa0-40e9-b968-b37c7c9a4c7e req-5659fe7a-e5e6-40bf-8a1d-f3a4add3d0cc service nova] Releasing lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Instance destroyed successfully.
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lazy-loading 'resources' on Instance uuid 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1010143228',display_name='tempest-TestMinimumBasicScenario-server-1010143228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1010143228',id=39,image_ref='0c75fb85-1689-4170-b511-766ce68710d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHfCo0ijcx/bxwlq7h95FsXQ+I3G/ieWSFebImFs141BK4rD0IdXfWBHqhI7SOEG7dexf4iX/d66OW+Op3IFsbpVQHGNF6Itw64uk3YbNY1Cr/RQ2hoDWiXFDm59JpCQQ==',key_name='tempest-TestMinimumBasicScenario-1288503622',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ee3a81531b34430b14fad85fe6c400c',ramdisk_id='',reservation_id='r-oqteyfb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c75fb85-1689-4170-b511-766ce68710d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1533627500',owner_user_name='tempest-TestMinimumBasicScenario-1533627500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:00:03Z,user_data=None,user_id='5076f53f390e4fc4b69fe0aa206a916c',uuid=353b264b-48d2-4b1a-b70a-6c9b0aa52b1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converting VIF {"id": "045dc6da-e423-458f-b666-25bbb02f3e50", "address": "fa:16:3e:8b:d7:aa", "network": {"id": "5e9692fc-fa98-48db-98c1-7cc8f88c21ae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1449038757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee3a81531b34430b14fad85fe6c400c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045dc6da-e4", "ovs_interfaceid": "045dc6da-e423-458f-b666-25bbb02f3e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG os_vif [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap045dc6da-e4, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:46 user nova-compute[73450]: INFO os_vif [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:d7:aa,bridge_name='br-int',has_traffic_filtering=True,id=045dc6da-e423-458f-b666-25bbb02f3e50,network=Network(5e9692fc-fa98-48db-98c1-7cc8f88c21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045dc6da-e4')
Aug 16 17:02:46 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Deleting instance files /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a_del
Aug 16 17:02:46 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Deletion of /opt/stack/data/nova/instances/353b264b-48d2-4b1a-b70a-6c9b0aa52b1a_del complete
Aug 16 17:02:47 user nova-compute[73450]: INFO nova.compute.manager [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-unplugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-unplugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-unplugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] Acquiring lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] No waiting events found dispatching network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:47 user nova-compute[73450]: WARNING nova.compute.manager [req-5c06db0e-3215-443c-9f5f-590e9fa3d824 req-a50c0ed9-019a-4fbf-9169-038cb5b4507e service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received unexpected event network-vif-plugged-045dc6da-e423-458f-b666-25bbb02f3e50 for instance with vm_state active and task_state deleting.
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:47 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Took 0.66 seconds to deallocate network for instance.
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:02:47 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:02:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:48 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Deleted allocations for instance 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a
Aug 16 17:02:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9da7b31e-b882-4663-a797-7073edcc8784 tempest-TestMinimumBasicScenario-1533627500 tempest-TestMinimumBasicScenario-1533627500-project-member] Lock "353b264b-48d2-4b1a-b70a-6c9b0aa52b1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-d7cff7fa-cb59-482d-8974-fcfa1e7b0999 req-5ebf1539-fd9d-49ba-93cc-a865b7d349f3 service nova] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Received event network-vif-deleted-045dc6da-e423-458f-b666-25bbb02f3e50 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srtGSAeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:02:51 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:02:51 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:02:51 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb5071-67b1-47cb-a761-1be80ec839da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:02:51 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5681ca3-feab-415e-b5f6-92390e9f8710]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb] added
Aug 16 17:02:51 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f029b27a-f7b4-4746-bf60-2263622aa374]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2064405d-c6e1-40e0-9b78-561c89e36973]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srtGSAeB {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srtGSAeB" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[54997d5b-9c18-44d4-b620-656b67884ed1]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srtGSAeB'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e9276d-805a-4285-9239-552786be3587]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1488fe-6e49-4108-af3b-62d84d974a16]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:51 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:51 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9be802-b05b-4ad7-9bf6-378a7ab1bb83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260]
Aug 16 17:02:51 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260] successful.
Aug 16 17:02:51 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b604620b-079e-464f-ba65-6ada4487d82a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[262356fa-4b56-443a-bf7c-5e3aff03f50e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:51 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:02:51 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:51 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:02:51 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2302b243-ade5-4659-bdb1-b2a8472abbf3]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:02:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srtGSAeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23538663538313266', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538663538313266', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:02:52 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:02:52 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:02:52 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:02:52 user nova-compute[73450]:   <serial>63c35cd8-3660-45b7-bd16-813de59662cb</serial>
Aug 16 17:02:52 user nova-compute[73450]: </disk>
Aug 16 17:02:52 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:02:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:02:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:02:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:c7:1c:d5, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:02:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-2c2843d8-116c-47ac-aea2-fb704353948a tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.723s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:02:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Creating image(s)
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Ensure instance console log exists: /opt/stack/data/nova/instances/5b8f9c0f-b6d8-47d6-bede-4a40e59527d9/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Start _get_guest_xml network_info=[{"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '9162d8e6-ca8c-48e3-b05b-f5dd18e90bf3', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtBCFPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b8f9c0f-b6d8-47d6-bede-4a40e59527d9', 'attached_at': '', 'detached_at': '', 'volume_id': '28d7b84b-b9ad-4b4a-80eb-80d74b735bbf', 'serial': '28d7b84b-b9ad-4b4a-80eb-80d74b735bbf'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:02:54 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:02:54 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtBCFPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:02:54 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:02:54 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:02:54 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e61609-fcbb-436f-a029-3970ee2c5e30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:02:54 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a20297-c174-4943-8cf6-555d3928659b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf] added
Aug 16 17:02:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a08d0-4b37-42f3-93a5-2d23cbd4ce27]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb885b17-f45f-47b5-acd0-35613d5d7a5c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AtBCFPbT {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AtBCFPbT" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f4fd7-7cc9-4fd2-8f4a-ba797326272f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AtBCFPbT'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff00c1f7-9919-4dbc-b225-7186388853c8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d8a18d-867e-4d99-9ae5-39a49c400c3b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:55 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:02:55 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:55 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:02:55 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d112615d-6ee8-462e-a03f-28aa366b8ff4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260]
Aug 16 17:02:55 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260] successful.
Aug 16 17:02:55 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7453505a-88dd-46ac-ab78-e99c42c5a3ac]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f694d0-a34b-46d2-837d-8c50acdec6de]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:55 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:02:55 user nova-compute[73450]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf (non-flash)
Aug 16 17:02:55 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:02:55 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:02:55 user nova-compute[73450]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf (non-flash)
Aug 16 17:02:55 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c78cb-f960-4424-b209-f73437d405bb]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:02:55 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtBCFPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26639373738656632', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639373738656632', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-924270984',display_name='tempest-TestVolumeBootPattern-server-924270984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-924270984',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-k571apdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:02:42Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=5b8f9c0f-b6d8-47d6-bede-4a40e59527d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:02:56 user nova-compute[73450]:   <uuid>5b8f9c0f-b6d8-47d6-bede-4a40e59527d9</uuid>
Aug 16 17:02:56 user nova-compute[73450]:   <name>instance-0000002b</name>
Aug 16 17:02:56 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:02:56 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:02:56 user nova-compute[73450]:   <metadata>
Aug 16 17:02:56 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:02:56 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:02:56 user nova-compute[73450]:       <nova:name>tempest-TestVolumeBootPattern-server-924270984</nova:name>
Aug 16 17:02:56 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:02:54</nova:creationTime>
Aug 16 17:02:56 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:02:56 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:02:56 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:02:56 user nova-compute[73450]:       <nova:owner>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:user uuid="8c95d246b43b45b4963f9d750ae89fbd">tempest-TestVolumeBootPattern-717711848-project-member</nova:user>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:project uuid="a3b953d82d634106aa0fb9574fafdc0d">tempest-TestVolumeBootPattern-717711848</nova:project>
Aug 16 17:02:56 user nova-compute[73450]:       </nova:owner>
Aug 16 17:02:56 user nova-compute[73450]:       <nova:ports>
Aug 16 17:02:56 user nova-compute[73450]:         <nova:port uuid="bd74a079-f869-4f99-a657-844139ad272b">
Aug 16 17:02:56 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 17:02:56 user nova-compute[73450]:         </nova:port>
Aug 16 17:02:56 user nova-compute[73450]:       </nova:ports>
Aug 16 17:02:56 user nova-compute[73450]:     </nova:instance>
Aug 16 17:02:56 user nova-compute[73450]:   </metadata>
Aug 16 17:02:56 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:02:56 user nova-compute[73450]:     <system>
Aug 16 17:02:56 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:02:56 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:02:56 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:02:56 user nova-compute[73450]:       <entry name="serial">5b8f9c0f-b6d8-47d6-bede-4a40e59527d9</entry>
Aug 16 17:02:56 user nova-compute[73450]:       <entry name="uuid">5b8f9c0f-b6d8-47d6-bede-4a40e59527d9</entry>
Aug 16 17:02:56 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:02:56 user nova-compute[73450]:     </system>
Aug 16 17:02:56 user nova-compute[73450]:   </sysinfo>
Aug 16 17:02:56 user nova-compute[73450]:   <os>
Aug 16 17:02:56 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:02:56 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:02:56 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:02:56 user nova-compute[73450]:   </os>
Aug 16 17:02:56 user nova-compute[73450]:   <features>
Aug 16 17:02:56 user nova-compute[73450]:     <acpi/>
Aug 16 17:02:56 user nova-compute[73450]:     <apic/>
Aug 16 17:02:56 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:02:56 user nova-compute[73450]:   </features>
Aug 16 17:02:56 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:02:56 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:02:56 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:02:56 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:02:56 user nova-compute[73450]:   </clock>
Aug 16 17:02:56 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:02:56 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:02:56 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:02:56 user nova-compute[73450]:   </cpu>
Aug 16 17:02:56 user nova-compute[73450]:   <devices>
Aug 16 17:02:56 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 17:02:56 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:02:56 user nova-compute[73450]:       <source dev="/dev/sdc"/>
Aug 16 17:02:56 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:02:56 user nova-compute[73450]:       <serial>28d7b84b-b9ad-4b4a-80eb-80d74b735bbf</serial>
Aug 16 17:02:56 user nova-compute[73450]:     </disk>
Aug 16 17:02:56 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:02:56 user nova-compute[73450]:       <mac address="fa:16:3e:82:76:91"/>
Aug 16 17:02:56 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:02:56 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:02:56 user nova-compute[73450]:       <target dev="tapbd74a079-f8"/>
Aug 16 17:02:56 user nova-compute[73450]:     </interface>
Aug 16 17:02:56 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:02:56 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/5b8f9c0f-b6d8-47d6-bede-4a40e59527d9/console.log" append="off"/>
Aug 16 17:02:56 user nova-compute[73450]:     </serial>
Aug 16 17:02:56 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:02:56 user nova-compute[73450]:     <video>
Aug 16 17:02:56 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:02:56 user nova-compute[73450]:     </video>
Aug 16 17:02:56 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:02:56 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:02:56 user nova-compute[73450]:     </rng>
Aug 16 17:02:56 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:02:56 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:02:56 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:02:56 user nova-compute[73450]:     </memballoon>
Aug 16 17:02:56 user nova-compute[73450]:   </devices>
Aug 16 17:02:56 user nova-compute[73450]: </domain>
Aug 16 17:02:56 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-924270984',display_name='tempest-TestVolumeBootPattern-server-924270984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-924270984',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-k571apdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:02:42Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=5b8f9c0f-b6d8-47d6-bede-4a40e59527d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG os_vif [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd74a079-f8, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd74a079-f8, col_values=(('external_ids', {'iface-id': 'bd74a079-f869-4f99-a657-844139ad272b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:76:91', 'vm-uuid': '5b8f9c0f-b6d8-47d6-bede-4a40e59527d9'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:56 user nova-compute[73450]: INFO os_vif [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8')
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] No VIF found with MAC fa:16:3e:82:76:91, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:02:57 user nova-compute[73450]: INFO nova.compute.claims [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Claim successful on node user
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205362.1270952, eed98e2e-e225-483c-93bf-b8100e2bc5fe => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:02:57 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] VM Stopped (Lifecycle Event)
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4cd74133-91f7-4c5f-98a1-e8848f13f6ac None None] [instance: eed98e2e-e225-483c-93bf-b8100e2bc5fe] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:02:57 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.policy [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e23eb33a56994696b7295fdfd0d04cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c0497e2014ad6a8b92a44097f4fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:02:57 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Creating image(s)
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-ba60b0d6-f0b1-4a52-b7c4-293d3ddd98d1 req-0134a502-600a-4578-a82f-0e8b12a8c808 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba60b0d6-f0b1-4a52-b7c4-293d3ddd98d1 req-0134a502-600a-4578-a82f-0e8b12a8c808 service nova] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba60b0d6-f0b1-4a52-b7c4-293d3ddd98d1 req-0134a502-600a-4578-a82f-0e8b12a8c808 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ba60b0d6-f0b1-4a52-b7c4-293d3ddd98d1 req-0134a502-600a-4578-a82f-0e8b12a8c808 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-ba60b0d6-f0b1-4a52-b7c4-293d3ddd98d1 req-0134a502-600a-4578-a82f-0e8b12a8c808 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] No waiting events found dispatching network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:02:57 user nova-compute[73450]: WARNING nova.compute.manager [req-ba60b0d6-f0b1-4a52-b7c4-293d3ddd98d1 req-0134a502-600a-4578-a82f-0e8b12a8c808 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received unexpected event network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b for instance with vm_state building and task_state spawning.
Aug 16 17:02:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.236s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk 1073741824" returned: 0 in 0.072s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG nova.network.neutron [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Successfully created port: a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Cannot resize image /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG nova.objects.instance [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'migration_context' on Instance uuid c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Ensure instance console log exists: /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:02:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Successfully updated port: a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquired lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-changed-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.compute.manager [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Refreshing instance network info cache due to event network-changed-a97fb092-a8e5-4ffc-bde9-5da177ae16f5. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] Acquiring lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Updating instance_info_cache with network_info: [{"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Releasing lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Instance network_info: |[{"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] Acquired lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.neutron [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Refreshing network info cache for port a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Start _get_guest_xml network_info=[{"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:02:59 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:02:59 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1616245468',display_name='tempest-AttachVolumeNegativeTest-server-1616245468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1616245468',id=44,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozuYF6F7H6weyR+ll5R2RqbOKzkzvd3QB4xYJL+oswxZmMpIG92onwRfHFnC/DCjpjVqGqOsrq2PvefO4GnBzHVLN0OqZWfxU442B28z+ONlSgL4MMeplvqd3zfeELkA==',key_name='tempest-keypair-799370292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-zpikhq6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.objects.instance [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'pci_devices' on Instance uuid c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:02:59 user nova-compute[73450]:   <uuid>c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f</uuid>
Aug 16 17:02:59 user nova-compute[73450]:   <name>instance-0000002c</name>
Aug 16 17:02:59 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:02:59 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:02:59 user nova-compute[73450]:   <metadata>
Aug 16 17:02:59 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:02:59 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:02:59 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1616245468</nova:name>
Aug 16 17:02:59 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:02:59</nova:creationTime>
Aug 16 17:02:59 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:02:59 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:02:59 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:02:59 user nova-compute[73450]:       <nova:owner>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:user uuid="e23eb33a56994696b7295fdfd0d04cac">tempest-AttachVolumeNegativeTest-1594829227-project-member</nova:user>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:project uuid="9b7c0497e2014ad6a8b92a44097f4fb7">tempest-AttachVolumeNegativeTest-1594829227</nova:project>
Aug 16 17:02:59 user nova-compute[73450]:       </nova:owner>
Aug 16 17:02:59 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:02:59 user nova-compute[73450]:       <nova:ports>
Aug 16 17:02:59 user nova-compute[73450]:         <nova:port uuid="a97fb092-a8e5-4ffc-bde9-5da177ae16f5">
Aug 16 17:02:59 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 17:02:59 user nova-compute[73450]:         </nova:port>
Aug 16 17:02:59 user nova-compute[73450]:       </nova:ports>
Aug 16 17:02:59 user nova-compute[73450]:     </nova:instance>
Aug 16 17:02:59 user nova-compute[73450]:   </metadata>
Aug 16 17:02:59 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:02:59 user nova-compute[73450]:     <system>
Aug 16 17:02:59 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:02:59 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:02:59 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:02:59 user nova-compute[73450]:       <entry name="serial">c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f</entry>
Aug 16 17:02:59 user nova-compute[73450]:       <entry name="uuid">c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f</entry>
Aug 16 17:02:59 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:02:59 user nova-compute[73450]:     </system>
Aug 16 17:02:59 user nova-compute[73450]:   </sysinfo>
Aug 16 17:02:59 user nova-compute[73450]:   <os>
Aug 16 17:02:59 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:02:59 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:02:59 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:02:59 user nova-compute[73450]:   </os>
Aug 16 17:02:59 user nova-compute[73450]:   <features>
Aug 16 17:02:59 user nova-compute[73450]:     <acpi/>
Aug 16 17:02:59 user nova-compute[73450]:     <apic/>
Aug 16 17:02:59 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:02:59 user nova-compute[73450]:   </features>
Aug 16 17:02:59 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:02:59 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:02:59 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:02:59 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:02:59 user nova-compute[73450]:   </clock>
Aug 16 17:02:59 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:02:59 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:02:59 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:02:59 user nova-compute[73450]:   </cpu>
Aug 16 17:02:59 user nova-compute[73450]:   <devices>
Aug 16 17:02:59 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:02:59 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:02:59 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk"/>
Aug 16 17:02:59 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:02:59 user nova-compute[73450]:     </disk>
Aug 16 17:02:59 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:02:59 user nova-compute[73450]:       <mac address="fa:16:3e:ec:7b:e2"/>
Aug 16 17:02:59 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:02:59 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:02:59 user nova-compute[73450]:       <target dev="tapa97fb092-a8"/>
Aug 16 17:02:59 user nova-compute[73450]:     </interface>
Aug 16 17:02:59 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:02:59 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/console.log" append="off"/>
Aug 16 17:02:59 user nova-compute[73450]:     </serial>
Aug 16 17:02:59 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:02:59 user nova-compute[73450]:     <video>
Aug 16 17:02:59 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:02:59 user nova-compute[73450]:     </video>
Aug 16 17:02:59 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:02:59 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:02:59 user nova-compute[73450]:     </rng>
Aug 16 17:02:59 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:02:59 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:02:59 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:02:59 user nova-compute[73450]:     </memballoon>
Aug 16 17:02:59 user nova-compute[73450]:   </devices>
Aug 16 17:02:59 user nova-compute[73450]: </domain>
Aug 16 17:02:59 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1616245468',display_name='tempest-AttachVolumeNegativeTest-server-1616245468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1616245468',id=44,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozuYF6F7H6weyR+ll5R2RqbOKzkzvd3QB4xYJL+oswxZmMpIG92onwRfHFnC/DCjpjVqGqOsrq2PvefO4GnBzHVLN0OqZWfxU442B28z+ONlSgL4MMeplvqd3zfeELkA==',key_name='tempest-keypair-799370292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-zpikhq6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG os_vif [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa97fb092-a8, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa97fb092-a8, col_values=(('external_ids', {'iface-id': 'a97fb092-a8e5-4ffc-bde9-5da177ae16f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7b:e2', 'vm-uuid': 'c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:02:59 user nova-compute[73450]: INFO os_vif [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8')
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:02:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:ec:7b:e2, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-03e5c1d5-be0b-4ac9-a681-3b0712316aba req-a3840739-c83f-4f1f-b286-927dad549e41 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-03e5c1d5-be0b-4ac9-a681-3b0712316aba req-a3840739-c83f-4f1f-b286-927dad549e41 service nova] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-03e5c1d5-be0b-4ac9-a681-3b0712316aba req-a3840739-c83f-4f1f-b286-927dad549e41 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-03e5c1d5-be0b-4ac9-a681-3b0712316aba req-a3840739-c83f-4f1f-b286-927dad549e41 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [req-03e5c1d5-be0b-4ac9-a681-3b0712316aba req-a3840739-c83f-4f1f-b286-927dad549e41 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] No waiting events found dispatching network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:00 user nova-compute[73450]: WARNING nova.compute.manager [req-03e5c1d5-be0b-4ac9-a681-3b0712316aba req-a3840739-c83f-4f1f-b286-927dad549e41 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received unexpected event network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b for instance with vm_state building and task_state spawning.
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205380.0283031, 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] VM Resumed (Lifecycle Event)
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Instance spawned successfully.
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205380.0287194, 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] VM Started (Lifecycle Event)
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Updated VIF entry in instance network info cache for port a97fb092-a8e5-4ffc-bde9-5da177ae16f5. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.network.neutron [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Updating instance_info_cache with network_info: [{"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7a6e14e8-91a2-4b6f-8585-5c62abc1eb0a req-e40fc7b7-a466-4fb7-b9d9-517b1cbd5879 service nova] Releasing lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 16 17:03:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:00 user nova-compute[73450]: INFO nova.compute.manager [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Took 18.69 seconds to build instance.
Aug 16 17:03:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b4d5bab3-38fc-4f5c-b7af-5a7b13b2a5f6 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.861s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6222a0c7-a56a-4dfd-acf0-69ed79f9e292 req-fc22c4be-be90-40d1-8579-f32a79285960 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6222a0c7-a56a-4dfd-acf0-69ed79f9e292 req-fc22c4be-be90-40d1-8579-f32a79285960 service nova] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6222a0c7-a56a-4dfd-acf0-69ed79f9e292 req-fc22c4be-be90-40d1-8579-f32a79285960 service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6222a0c7-a56a-4dfd-acf0-69ed79f9e292 req-fc22c4be-be90-40d1-8579-f32a79285960 service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:01 user nova-compute[73450]: DEBUG nova.compute.manager [req-6222a0c7-a56a-4dfd-acf0-69ed79f9e292 req-fc22c4be-be90-40d1-8579-f32a79285960 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] No waiting events found dispatching network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:01 user nova-compute[73450]: WARNING nova.compute.manager [req-6222a0c7-a56a-4dfd-acf0-69ed79f9e292 req-fc22c4be-be90-40d1-8579-f32a79285960 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received unexpected event network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 for instance with vm_state building and task_state spawning.
Aug 16 17:03:01 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205366.9278746, 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:01 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] VM Stopped (Lifecycle Event)
Aug 16 17:03:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-3ccabcad-a215-4ec7-972a-ce7a01a9f9fb None None] [instance: 353b264b-48d2-4b1a-b70a-6c9b0aa52b1a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:03:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-c1c56827-f2ed-4b14-875d-1563bf06f90b req-89e56369-dbcc-4e4d-9da1-18b00fe6697f service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c1c56827-f2ed-4b14-875d-1563bf06f90b req-89e56369-dbcc-4e4d-9da1-18b00fe6697f service nova] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c1c56827-f2ed-4b14-875d-1563bf06f90b req-89e56369-dbcc-4e4d-9da1-18b00fe6697f service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c1c56827-f2ed-4b14-875d-1563bf06f90b req-89e56369-dbcc-4e4d-9da1-18b00fe6697f service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-c1c56827-f2ed-4b14-875d-1563bf06f90b req-89e56369-dbcc-4e4d-9da1-18b00fe6697f service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] No waiting events found dispatching network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:03 user nova-compute[73450]: WARNING nova.compute.manager [req-c1c56827-f2ed-4b14-875d-1563bf06f90b req-89e56369-dbcc-4e4d-9da1-18b00fe6697f service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received unexpected event network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 for instance with vm_state building and task_state spawning.
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205383.6835678, c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:03 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] VM Resumed (Lifecycle Event)
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:03:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Instance spawned successfully.
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205383.6843123, c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] VM Started (Lifecycle Event)
Aug 16 17:03:04 user nova-compute[73450]: INFO nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:04 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:03:04 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8164MB free_disk=23.79843521118164GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:04 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:04 user nova-compute[73450]: INFO nova.compute.manager [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Took 7.42 seconds to build instance.
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b1da2b30-72cd-46f8-8620-d8c044e79c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d2e7d814-bd0b-45f6-b1e4-59e24398fa95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-879aef01-306a-4fb9-a9ac-b4046944938b tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.595s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:03:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:03:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:03:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:03:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:03:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:03:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-changed-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:17 user nova-compute[73450]: DEBUG nova.compute.manager [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Refreshing instance network info cache due to event network-changed-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:03:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] Acquiring lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:03:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] Acquired lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:03:17 user nova-compute[73450]: DEBUG nova.network.neutron [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Refreshing network info cache for port 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:18 user nova-compute[73450]: INFO nova.compute.manager [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Terminating instance
Aug 16 17:03:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-572e88d6-c901-41c5-a433-5ec759347e40 req-6e241300-2411-442f-8882-63650bd5b216 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-unplugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-572e88d6-c901-41c5-a433-5ec759347e40 req-6e241300-2411-442f-8882-63650bd5b216 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-572e88d6-c901-41c5-a433-5ec759347e40 req-6e241300-2411-442f-8882-63650bd5b216 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-572e88d6-c901-41c5-a433-5ec759347e40 req-6e241300-2411-442f-8882-63650bd5b216 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-572e88d6-c901-41c5-a433-5ec759347e40 req-6e241300-2411-442f-8882-63650bd5b216 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-unplugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-572e88d6-c901-41c5-a433-5ec759347e40 req-6e241300-2411-442f-8882-63650bd5b216 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-unplugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updated VIF entry in instance network info cache for port 492e08a1-1bdc-47ea-ad6f-b7e77e6641e8. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.network.neutron [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating instance_info_cache with network_info: [{"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Instance destroyed successfully.
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.objects.instance [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lazy-loading 'resources' on Instance uuid b1da2b30-72cd-46f8-8620-d8c044e79c96 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b02e82e9-779b-4dc2-a8fc-f50f86cc144c req-0ff826fe-458f-4fb1-8b90-a59453bea7bb service nova] Releasing lock "refresh_cache-b1da2b30-72cd-46f8-8620-d8c044e79c96" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T16:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255447583',display_name='tempest-TestStampPattern-server-1255447583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255447583',id=36,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYwZqnqg7dO+ytxFjz6XdBi4yIzNz/7UrcYmlm0Yp3fzTPnQGAJvVEeoFigebR3Ay8FkG/g2G8In8fH/us7360kHsj5Ihla9q+Tr8gMmAHGnvFblbO8Eikw5YPaOPmJg==',key_name='tempest-TestStampPattern-481591227',keypairs=<?>,launch_index=0,launched_at=2023-08-16T16:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33ace27d486848e4a6ae14949629da11',ramdisk_id='',reservation_id='r-kmdv3d8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1739750355',owner_user_name='tempest-TestStampPattern-1739750355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T16:59:09Z,user_data=None,user_id='3204a7c592ff4585be593753006fd5bb',uuid=b1da2b30-72cd-46f8-8620-d8c044e79c96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converting VIF {"id": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "address": "fa:16:3e:57:a2:63", "network": {"id": "8cdf491c-ffc2-4f0d-a3c6-e130470a5de1", "bridge": "br-int", "label": "tempest-TestStampPattern-1339082742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ace27d486848e4a6ae14949629da11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap492e08a1-1b", "ovs_interfaceid": "492e08a1-1bdc-47ea-ad6f-b7e77e6641e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG os_vif [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap492e08a1-1b, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:03:19 user nova-compute[73450]: INFO os_vif [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=492e08a1-1bdc-47ea-ad6f-b7e77e6641e8,network=Network(8cdf491c-ffc2-4f0d-a3c6-e130470a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap492e08a1-1b')
Aug 16 17:03:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Deleting instance files /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96_del
Aug 16 17:03:19 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Deletion of /opt/stack/data/nova/instances/b1da2b30-72cd-46f8-8620-d8c044e79c96_del complete
Aug 16 17:03:19 user nova-compute[73450]: INFO nova.compute.manager [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 17:03:19 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:20 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Took 0.78 seconds to deallocate network for instance.
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-ca003f50-2138-47c3-9349-695e8580dcb1 req-26c2e503-dd97-4243-b99e-5ae91ba7bada service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-deleted-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Deleted allocations for instance b1da2b30-72cd-46f8-8620-d8c044e79c96
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-4a17fbe2-f2f5-4da3-a80b-1443dfe25873 tempest-TestStampPattern-1739750355 tempest-TestStampPattern-1739750355-project-member] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:20 user nova-compute[73450]: WARNING nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state deleted and task_state None.
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:20 user nova-compute[73450]: WARNING nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state deleted and task_state None.
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:20 user nova-compute[73450]: WARNING nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state deleted and task_state None.
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-unplugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-unplugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:20 user nova-compute[73450]: WARNING nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-unplugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state deleted and task_state None.
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Acquiring lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] Lock "b1da2b30-72cd-46f8-8620-d8c044e79c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] No waiting events found dispatching network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:20 user nova-compute[73450]: WARNING nova.compute.manager [req-261b556d-63c1-42a4-9460-7d25fe9cd014 req-d0a81259-91e2-49c4-a0bd-54495e8c8c58 service nova] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Received unexpected event network-vif-plugged-492e08a1-1bdc-47ea-ad6f-b7e77e6641e8 for instance with vm_state deleted and task_state None.
Aug 16 17:03:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:34 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205399.179231, b1da2b30-72cd-46f8-8620-d8c044e79c96 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:34 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] VM Stopped (Lifecycle Event)
Aug 16 17:03:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5d0c2056-85a0-4330-b05f-97080ca366f7 None None] [instance: b1da2b30-72cd-46f8-8620-d8c044e79c96] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:03:50 user nova-compute[73450]: INFO nova.compute.claims [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Claim successful on node user
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.network.neutron [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:03:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.policy [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a86e84a3c404ab6af0794f17a8d4ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79240e658cc64592aba46bb80975c127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:03:50 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Creating image(s)
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk 1073741824" returned: 0 in 0.053s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG nova.network.neutron [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Successfully created port: 5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Cannot resize image /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG nova.objects.instance [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'migration_context' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Ensure instance console log exists: /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Successfully updated port: 5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-changed-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Refreshing instance network info cache due to event network-changed-5e09f50e-da33-40bf-bf8b-eb5e3c725c48. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:03:52 user nova-compute[73450]: INFO nova.compute.claims [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Claim successful on node user
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance network_info: |[{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.neutron [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Refreshing network info cache for port 5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start _get_guest_xml network_info=[{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:03:52 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:03:52 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:03:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'pci_devices' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:03:52 user nova-compute[73450]:   <uuid>e28e8532-9094-44ba-9069-d7af964ba11a</uuid>
Aug 16 17:03:52 user nova-compute[73450]:   <name>instance-0000002d</name>
Aug 16 17:03:52 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:03:52 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:03:52 user nova-compute[73450]:   <metadata>
Aug 16 17:03:52 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:03:52 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:03:52 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherB-server-877252721</nova:name>
Aug 16 17:03:52 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:03:52</nova:creationTime>
Aug 16 17:03:52 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:03:52 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:03:52 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:03:52 user nova-compute[73450]:       <nova:owner>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:user uuid="4a86e84a3c404ab6af0794f17a8d4ef3">tempest-ServerActionsTestOtherB-616819457-project-member</nova:user>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:project uuid="79240e658cc64592aba46bb80975c127">tempest-ServerActionsTestOtherB-616819457</nova:project>
Aug 16 17:03:52 user nova-compute[73450]:       </nova:owner>
Aug 16 17:03:52 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:03:52 user nova-compute[73450]:       <nova:ports>
Aug 16 17:03:52 user nova-compute[73450]:         <nova:port uuid="5e09f50e-da33-40bf-bf8b-eb5e3c725c48">
Aug 16 17:03:52 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 17:03:52 user nova-compute[73450]:         </nova:port>
Aug 16 17:03:52 user nova-compute[73450]:       </nova:ports>
Aug 16 17:03:52 user nova-compute[73450]:     </nova:instance>
Aug 16 17:03:52 user nova-compute[73450]:   </metadata>
Aug 16 17:03:52 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:03:52 user nova-compute[73450]:     <system>
Aug 16 17:03:52 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:03:52 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:03:52 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:03:52 user nova-compute[73450]:       <entry name="serial">e28e8532-9094-44ba-9069-d7af964ba11a</entry>
Aug 16 17:03:52 user nova-compute[73450]:       <entry name="uuid">e28e8532-9094-44ba-9069-d7af964ba11a</entry>
Aug 16 17:03:52 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:03:52 user nova-compute[73450]:     </system>
Aug 16 17:03:52 user nova-compute[73450]:   </sysinfo>
Aug 16 17:03:52 user nova-compute[73450]:   <os>
Aug 16 17:03:52 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:03:52 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:03:52 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:03:52 user nova-compute[73450]:   </os>
Aug 16 17:03:52 user nova-compute[73450]:   <features>
Aug 16 17:03:52 user nova-compute[73450]:     <acpi/>
Aug 16 17:03:52 user nova-compute[73450]:     <apic/>
Aug 16 17:03:52 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:03:52 user nova-compute[73450]:   </features>
Aug 16 17:03:52 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:03:52 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:03:52 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:03:52 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:03:52 user nova-compute[73450]:   </clock>
Aug 16 17:03:52 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:03:52 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:03:52 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:03:52 user nova-compute[73450]:   </cpu>
Aug 16 17:03:52 user nova-compute[73450]:   <devices>
Aug 16 17:03:52 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:03:52 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:03:52 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk"/>
Aug 16 17:03:52 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:03:52 user nova-compute[73450]:     </disk>
Aug 16 17:03:52 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:03:52 user nova-compute[73450]:       <mac address="fa:16:3e:8b:89:8b"/>
Aug 16 17:03:52 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:03:52 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:03:52 user nova-compute[73450]:       <target dev="tap5e09f50e-da"/>
Aug 16 17:03:52 user nova-compute[73450]:     </interface>
Aug 16 17:03:52 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:03:52 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/console.log" append="off"/>
Aug 16 17:03:52 user nova-compute[73450]:     </serial>
Aug 16 17:03:52 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:03:52 user nova-compute[73450]:     <video>
Aug 16 17:03:52 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:03:52 user nova-compute[73450]:     </video>
Aug 16 17:03:52 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:03:52 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:03:52 user nova-compute[73450]:     </rng>
Aug 16 17:03:52 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:03:52 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:03:52 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:03:52 user nova-compute[73450]:     </memballoon>
Aug 16 17:03:52 user nova-compute[73450]:   </devices>
Aug 16 17:03:52 user nova-compute[73450]: </domain>
Aug 16 17:03:52 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:03:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG os_vif [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:03:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e09f50e-da, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e09f50e-da, col_values=(('external_ids', {'iface-id': '5e09f50e-da33-40bf-bf8b-eb5e3c725c48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:89:8b', 'vm-uuid': 'e28e8532-9094-44ba-9069-d7af964ba11a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:03:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:52 user nova-compute[73450]: INFO os_vif [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da')
Aug 16 17:03:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.policy [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b7113acfc8d4d5296c710263ce33f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436aa2ca57fd4043aaa97b006f85c3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No VIF found with MAC fa:16:3e:8b:89:8b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:03:53 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Creating image(s)
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "/opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "/opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "/opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.208s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.network.neutron [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated VIF entry in instance network info cache for port 5e09f50e-da33-40bf-bf8b-eb5e3c725c48. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.network.neutron [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b9982cf9-95ae-4c69-9768-50ffd6a3c26c req-924a8f22-f724-43aa-8978-6be56d5c0a38 service nova] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk 1073741824" returned: 0 in 0.143s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.network.neutron [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Successfully created port: 5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Cannot resize image /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.objects.instance [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'migration_context' on Instance uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Ensure instance console log exists: /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-d4c398ad-d1fc-44f6-9042-8055f3b3dcd7 req-df85b7dd-caca-4d37-b3fd-67199f08e09f service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d4c398ad-d1fc-44f6-9042-8055f3b3dcd7 req-df85b7dd-caca-4d37-b3fd-67199f08e09f service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d4c398ad-d1fc-44f6-9042-8055f3b3dcd7 req-df85b7dd-caca-4d37-b3fd-67199f08e09f service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d4c398ad-d1fc-44f6-9042-8055f3b3dcd7 req-df85b7dd-caca-4d37-b3fd-67199f08e09f service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-d4c398ad-d1fc-44f6-9042-8055f3b3dcd7 req-df85b7dd-caca-4d37-b3fd-67199f08e09f service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:54 user nova-compute[73450]: WARNING nova.compute.manager [req-d4c398ad-d1fc-44f6-9042-8055f3b3dcd7 req-df85b7dd-caca-4d37-b3fd-67199f08e09f service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state building and task_state spawning.
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Successfully updated port: 5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquired lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-changed-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Refreshing instance network info cache due to event network-changed-5307acd5-298d-44ee-9114-1ab118ae9931. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] Acquiring lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:03:54 user nova-compute[73450]: DEBUG nova.network.neutron [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updating instance_info_cache with network_info: [{"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Releasing lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Instance network_info: |[{"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] Acquired lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Refreshing network info cache for port 5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Start _get_guest_xml network_info=[{"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:03:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:03:55 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1715631814',display_name='tempest-VolumesSnapshotTestJSON-instance-1715631814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1715631814',id=46,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrw89w9i7s7OTKGuT7paQ3h4cHKUGnpYcWj+bDG7uvvwzwwdDBKsOhhYz88B1c1pBa6rlqXNuo2DQ49LuCuKN7hcjoPoQADRy4ENCV2HELxoEO6G+HpYz8l+oqFOa3/Jg==',key_name='tempest-keypair-324166830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='436aa2ca57fd4043aaa97b006f85c3dd',ramdisk_id='',reservation_id='r-6dr46r7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1425912104',owner_user_name='tempest-VolumesSnapshotTestJSON-1425912104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b7113acfc8d4d5296c710263ce33f08',uuid=a12612d5-83d4-4f3d-bf19-892f07886cdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converting VIF {"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'pci_devices' on Instance uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:03:55 user nova-compute[73450]:   <uuid>a12612d5-83d4-4f3d-bf19-892f07886cdc</uuid>
Aug 16 17:03:55 user nova-compute[73450]:   <name>instance-0000002e</name>
Aug 16 17:03:55 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:03:55 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:03:55 user nova-compute[73450]:   <metadata>
Aug 16 17:03:55 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:03:55 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:03:55 user nova-compute[73450]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1715631814</nova:name>
Aug 16 17:03:55 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:03:55</nova:creationTime>
Aug 16 17:03:55 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:03:55 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:03:55 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:03:55 user nova-compute[73450]:       <nova:owner>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:user uuid="1b7113acfc8d4d5296c710263ce33f08">tempest-VolumesSnapshotTestJSON-1425912104-project-member</nova:user>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:project uuid="436aa2ca57fd4043aaa97b006f85c3dd">tempest-VolumesSnapshotTestJSON-1425912104</nova:project>
Aug 16 17:03:55 user nova-compute[73450]:       </nova:owner>
Aug 16 17:03:55 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:03:55 user nova-compute[73450]:       <nova:ports>
Aug 16 17:03:55 user nova-compute[73450]:         <nova:port uuid="5307acd5-298d-44ee-9114-1ab118ae9931">
Aug 16 17:03:55 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 17:03:55 user nova-compute[73450]:         </nova:port>
Aug 16 17:03:55 user nova-compute[73450]:       </nova:ports>
Aug 16 17:03:55 user nova-compute[73450]:     </nova:instance>
Aug 16 17:03:55 user nova-compute[73450]:   </metadata>
Aug 16 17:03:55 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:03:55 user nova-compute[73450]:     <system>
Aug 16 17:03:55 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:03:55 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:03:55 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:03:55 user nova-compute[73450]:       <entry name="serial">a12612d5-83d4-4f3d-bf19-892f07886cdc</entry>
Aug 16 17:03:55 user nova-compute[73450]:       <entry name="uuid">a12612d5-83d4-4f3d-bf19-892f07886cdc</entry>
Aug 16 17:03:55 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:03:55 user nova-compute[73450]:     </system>
Aug 16 17:03:55 user nova-compute[73450]:   </sysinfo>
Aug 16 17:03:55 user nova-compute[73450]:   <os>
Aug 16 17:03:55 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:03:55 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:03:55 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:03:55 user nova-compute[73450]:   </os>
Aug 16 17:03:55 user nova-compute[73450]:   <features>
Aug 16 17:03:55 user nova-compute[73450]:     <acpi/>
Aug 16 17:03:55 user nova-compute[73450]:     <apic/>
Aug 16 17:03:55 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:03:55 user nova-compute[73450]:   </features>
Aug 16 17:03:55 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:03:55 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:03:55 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:03:55 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:03:55 user nova-compute[73450]:   </clock>
Aug 16 17:03:55 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:03:55 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:03:55 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:03:55 user nova-compute[73450]:   </cpu>
Aug 16 17:03:55 user nova-compute[73450]:   <devices>
Aug 16 17:03:55 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:03:55 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:03:55 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk"/>
Aug 16 17:03:55 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:03:55 user nova-compute[73450]:     </disk>
Aug 16 17:03:55 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:03:55 user nova-compute[73450]:       <mac address="fa:16:3e:22:35:a7"/>
Aug 16 17:03:55 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:03:55 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:03:55 user nova-compute[73450]:       <target dev="tap5307acd5-29"/>
Aug 16 17:03:55 user nova-compute[73450]:     </interface>
Aug 16 17:03:55 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:03:55 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/console.log" append="off"/>
Aug 16 17:03:55 user nova-compute[73450]:     </serial>
Aug 16 17:03:55 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:03:55 user nova-compute[73450]:     <video>
Aug 16 17:03:55 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:03:55 user nova-compute[73450]:     </video>
Aug 16 17:03:55 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:03:55 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:03:55 user nova-compute[73450]:     </rng>
Aug 16 17:03:55 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:03:55 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:03:55 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:03:55 user nova-compute[73450]:     </memballoon>
Aug 16 17:03:55 user nova-compute[73450]:   </devices>
Aug 16 17:03:55 user nova-compute[73450]: </domain>
Aug 16 17:03:55 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1715631814',display_name='tempest-VolumesSnapshotTestJSON-instance-1715631814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1715631814',id=46,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrw89w9i7s7OTKGuT7paQ3h4cHKUGnpYcWj+bDG7uvvwzwwdDBKsOhhYz88B1c1pBa6rlqXNuo2DQ49LuCuKN7hcjoPoQADRy4ENCV2HELxoEO6G+HpYz8l+oqFOa3/Jg==',key_name='tempest-keypair-324166830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='436aa2ca57fd4043aaa97b006f85c3dd',ramdisk_id='',reservation_id='r-6dr46r7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1425912104',owner_user_name='tempest-VolumesSnapshotTestJSON-1425912104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b7113acfc8d4d5296c710263ce33f08',uuid=a12612d5-83d4-4f3d-bf19-892f07886cdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converting VIF {"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG os_vif [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5307acd5-29, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5307acd5-29, col_values=(('external_ids', {'iface-id': '5307acd5-298d-44ee-9114-1ab118ae9931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:35:a7', 'vm-uuid': 'a12612d5-83d4-4f3d-bf19-892f07886cdc'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:55 user nova-compute[73450]: INFO os_vif [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29')
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No VIF found with MAC fa:16:3e:22:35:a7, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updated VIF entry in instance network info cache for port 5307acd5-298d-44ee-9114-1ab118ae9931. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG nova.network.neutron [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updating instance_info_cache with network_info: [{"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6dba4983-61bf-44c8-b753-0cd43a83cab4 req-c02bb2cc-d459-40a0-a3d6-d2f667a4c0d1 service nova] Releasing lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-de216aa8-e13e-4d07-87b8-94edef9ec806 req-c03cd98f-1eac-4f71-b5d0-ba51cb4f5dda service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-de216aa8-e13e-4d07-87b8-94edef9ec806 req-c03cd98f-1eac-4f71-b5d0-ba51cb4f5dda service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-de216aa8-e13e-4d07-87b8-94edef9ec806 req-c03cd98f-1eac-4f71-b5d0-ba51cb4f5dda service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-de216aa8-e13e-4d07-87b8-94edef9ec806 req-c03cd98f-1eac-4f71-b5d0-ba51cb4f5dda service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [req-de216aa8-e13e-4d07-87b8-94edef9ec806 req-c03cd98f-1eac-4f71-b5d0-ba51cb4f5dda service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:56 user nova-compute[73450]: WARNING nova.compute.manager [req-de216aa8-e13e-4d07-87b8-94edef9ec806 req-c03cd98f-1eac-4f71-b5d0-ba51cb4f5dda service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state building and task_state spawning.
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205436.660368, e28e8532-9094-44ba-9069-d7af964ba11a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Resumed (Lifecycle Event)
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance spawned successfully.
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205436.6606402, e28e8532-9094-44ba-9069-d7af964ba11a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Started (Lifecycle Event)
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 16 17:03:56 user nova-compute[73450]: DEBUG nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:56 user nova-compute[73450]: INFO nova.compute.manager [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Took 6.67 seconds to build instance.
Aug 16 17:03:56 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-ca67443e-5a2b-4d2f-b3e2-646c4104cf2d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.784s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Skipping network cache update for instance because it is Building. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid d2e7d814-bd0b-45f6-b1e4-59e24398fa95 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating instance_info_cache with network_info: [{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:03:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] No waiting events found dispatching network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:58 user nova-compute[73450]: WARNING nova.compute.manager [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received unexpected event network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 for instance with vm_state building and task_state spawning.
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] No waiting events found dispatching network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:03:58 user nova-compute[73450]: WARNING nova.compute.manager [req-b994e260-5ca3-428c-8c41-3bcfe94bb000 req-472a2b16-a2b0-4e03-bf91-9a15a407dde2 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received unexpected event network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 for instance with vm_state building and task_state spawning.
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205438.9085157, a12612d5-83d4-4f3d-bf19-892f07886cdc => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] VM Resumed (Lifecycle Event)
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:03:58 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Instance spawned successfully.
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:03:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205438.9119124, a12612d5-83d4-4f3d-bf19-892f07886cdc => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:03:58 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] VM Started (Lifecycle Event)
Aug 16 17:03:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:03:59 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:03:59 user nova-compute[73450]: INFO nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 16 17:03:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:03:59 user nova-compute[73450]: INFO nova.compute.manager [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Took 6.69 seconds to build instance.
Aug 16 17:03:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-70591db3-e455-468e-90c1-27766c45788c tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.802s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:01 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:01 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:06 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:04:06 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8031MB free_disk=23.92810821533203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d2e7d814-bd0b-45f6-b1e4-59e24398fa95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a12612d5-83d4-4f3d-bf19-892f07886cdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:04:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:04:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-changed-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Refreshing instance network info cache due to event network-changed-bd74a079-f869-4f99-a657-844139ad272b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:04:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] Acquiring lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:04:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] Acquired lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:04:34 user nova-compute[73450]: DEBUG nova.network.neutron [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Refreshing network info cache for port bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updated VIF entry in instance network info cache for port bd74a079-f869-4f99-a657-844139ad272b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updating instance_info_cache with network_info: [{"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-99a43f8a-f9f6-435a-9fd7-67be9865c730 req-1e5476e4-0a67-47fe-8ec1-69b46b190e98 service nova] Releasing lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-changed-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Refreshing instance network info cache due to event network-changed-bd74a079-f869-4f99-a657-844139ad272b. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] Acquiring lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] Acquired lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Refreshing network info cache for port bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:35 user nova-compute[73450]: INFO nova.compute.manager [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Terminating instance
Aug 16 17:04:35 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Instance destroyed successfully.
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'resources' on Instance uuid 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-924270984',display_name='tempest-TestVolumeBootPattern-server-924270984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-924270984',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-k571apdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:03:00Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=5b8f9c0f-b6d8-47d6-bede-4a40e59527d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_vif [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.network.neutron [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updated VIF entry in instance network info cache for port bd74a079-f869-4f99-a657-844139ad272b. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.network.neutron [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updating instance_info_cache with network_info: [{"id": "bd74a079-f869-4f99-a657-844139ad272b", "address": "fa:16:3e:82:76:91", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd74a079-f8", "ovs_interfaceid": "bd74a079-f869-4f99-a657-844139ad272b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd74a079-f8, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:04:36 user nova-compute[73450]: INFO os_vif [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:76:91,bridge_name='br-int',has_traffic_filtering=True,id=bd74a079-f869-4f99-a657-844139ad272b,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd74a079-f8')
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtBCFPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:04:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-43a49103-f34f-4cb2-9354-eb204d4a4940 req-61ef2857-298e-44f4-a8c2-ff4fbf2c70ce service nova] Releasing lock "refresh_cache-5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c1b83-9aa8-4bb1-a9e4-5c74688a4025]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c864f-a51d-494d-bd0d-82bdfc47c8b6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:04:36 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:04:36 user nova-compute[73450]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf (non-flash)
Aug 16 17:04:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:04:36 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:04:36 user nova-compute[73450]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf (non-flash)
Aug 16 17:04:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe280290280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb4b19f-86c6-4dd0-8cbe-68103737682b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86914c01-4df2-4c17-8344-13a2076fdd07]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23637c9-cf28-45ec-8544-3c3fd814fb3a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c294bde-ebff-4b7b-b292-e7a8d0872d46]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cdff7d-f780-4243-9c03-868da7beacb2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef9a9d-6019-4eb3-af06-f1a08a4fe737]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260]
Aug 16 17:04:36 user nova-compute[73450]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf, portal: 172.16.0.220,3260] successful.
Aug 16 17:04:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d7b84b-b9ad-4b4a-80eb-80d74b735bbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cefecee-1773-46b7-9548-ec21161a7811]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== disconnect_volume: return (288ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:04:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Deleting instance files /opt/stack/data/nova/instances/5b8f9c0f-b6d8-47d6-bede-4a40e59527d9_del
Aug 16 17:04:36 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Deletion of /opt/stack/data/nova/instances/5b8f9c0f-b6d8-47d6-bede-4a40e59527d9_del complete
Aug 16 17:04:36 user nova-compute[73450]: INFO nova.compute.manager [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 17:04:36 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:04:36 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Took 0.51 seconds to deallocate network for instance.
Aug 16 17:04:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-e1232802-bca1-401c-854d-f0015da7eb2c req-65ff88da-bd79-48e7-ae87-32a640f43d5d service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-vif-deleted-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-vif-unplugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] No waiting events found dispatching network-vif-unplugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-vif-unplugged-bd74a079-f869-4f99-a657-844139ad272b for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received event network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] Acquiring lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] No waiting events found dispatching network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:04:37 user nova-compute[73450]: WARNING nova.compute.manager [req-6c283570-f235-4b51-8875-22c89ff99524 req-8cbc347b-c907-4f99-a713-e1957edfef76 service nova] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Received unexpected event network-vif-plugged-bd74a079-f869-4f99-a657-844139ad272b for instance with vm_state active and task_state deleting.
Aug 16 17:04:37 user nova-compute[73450]: INFO nova.compute.manager [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Took 0.76 seconds to detach 1 volumes for instance.
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:04:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:04:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:38 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Deleted allocations for instance 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9
Aug 16 17:04:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b55c1fcb-220b-4226-b144-55338117d2ed tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "5b8f9c0f-b6d8-47d6-bede-4a40e59527d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-changed-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG nova.compute.manager [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Refreshing instance network info cache due to event network-changed-a97fb092-a8e5-4ffc-bde9-5da177ae16f5. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] Acquiring lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] Acquired lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Refreshing network info cache for port a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:48 user nova-compute[73450]: INFO nova.compute.manager [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Terminating instance
Aug 16 17:04:48 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Updated VIF entry in instance network info cache for port a97fb092-a8e5-4ffc-bde9-5da177ae16f5. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG nova.network.neutron [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Updating instance_info_cache with network_info: [{"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:48 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-10a5b9db-8809-44f9-93df-788de007dcba req-7ef05677-8782-4b5e-8855-950947d3e5d7 service nova] Releasing lock "refresh_cache-c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-22075e22-ec48-4ca3-b36a-8f3f9db1c122 req-444875aa-f83d-41cc-bcda-88b186e084b1 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-vif-unplugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-22075e22-ec48-4ca3-b36a-8f3f9db1c122 req-444875aa-f83d-41cc-bcda-88b186e084b1 service nova] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-22075e22-ec48-4ca3-b36a-8f3f9db1c122 req-444875aa-f83d-41cc-bcda-88b186e084b1 service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-22075e22-ec48-4ca3-b36a-8f3f9db1c122 req-444875aa-f83d-41cc-bcda-88b186e084b1 service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-22075e22-ec48-4ca3-b36a-8f3f9db1c122 req-444875aa-f83d-41cc-bcda-88b186e084b1 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] No waiting events found dispatching network-vif-unplugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-22075e22-ec48-4ca3-b36a-8f3f9db1c122 req-444875aa-f83d-41cc-bcda-88b186e084b1 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-vif-unplugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Instance destroyed successfully.
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'resources' on Instance uuid c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1616245468',display_name='tempest-AttachVolumeNegativeTest-server-1616245468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1616245468',id=44,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozuYF6F7H6weyR+ll5R2RqbOKzkzvd3QB4xYJL+oswxZmMpIG92onwRfHFnC/DCjpjVqGqOsrq2PvefO4GnBzHVLN0OqZWfxU442B28z+ONlSgL4MMeplvqd3zfeELkA==',key_name='tempest-keypair-799370292',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-zpikhq6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "address": "fa:16:3e:ec:7b:e2", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97fb092-a8", "ovs_interfaceid": "a97fb092-a8e5-4ffc-bde9-5da177ae16f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG os_vif [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa97fb092-a8, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:04:49 user nova-compute[73450]: INFO os_vif [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7b:e2,bridge_name='br-int',has_traffic_filtering=True,id=a97fb092-a8e5-4ffc-bde9-5da177ae16f5,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97fb092-a8')
Aug 16 17:04:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Deleting instance files /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f_del
Aug 16 17:04:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Deletion of /opt/stack/data/nova/instances/c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f_del complete
Aug 16 17:04:49 user nova-compute[73450]: INFO nova.compute.manager [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 16 17:04:49 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:04:49 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:04:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:50 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:04:50 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Took 0.94 seconds to deallocate network for instance.
Aug 16 17:04:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:50 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:04:50 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:04:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:50 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Deleted allocations for instance c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f
Aug 16 17:04:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9f6c8a79-24e0-4d76-be35-805aa152cde6 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:51 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205476.0373485, 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:04:51 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] VM Stopped (Lifecycle Event)
Aug 16 17:04:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fb47add8-e2fa-4607-a55b-e3a28e0ff24e None None] [instance: 5b8f9c0f-b6d8-47d6-bede-4a40e59527d9] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:04:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] Acquiring lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:04:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:04:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] Lock "c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:04:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] No waiting events found dispatching network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:04:51 user nova-compute[73450]: WARNING nova.compute.manager [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received unexpected event network-vif-plugged-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 for instance with vm_state deleted and task_state None.
Aug 16 17:04:51 user nova-compute[73450]: DEBUG nova.compute.manager [req-69562c10-dc5e-4a16-9435-46f49ad153f4 req-3c20ea56-97a2-48c3-b0ca-e5398e134b75 service nova] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Received event network-vif-deleted-a97fb092-a8e5-4ffc-bde9-5da177ae16f5 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:04:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updating instance_info_cache with network_info: [{"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-52a40134-ade0-4c24-9f7d-7840b9fb8593" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:04:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:01 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:02 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:04 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205489.3859959, c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:05:04 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] VM Stopped (Lifecycle Event)
Aug 16 17:05:04 user nova-compute[73450]: DEBUG nova.compute.manager [None req-bb2a8eb2-d8df-434e-b50b-3e449f3049fe None None] [instance: c9ca34a4-c2dc-4d85-8fe8-9c9e3a0f975f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:05:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:05:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:06 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:05:06 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8316MB free_disk=23.890621185302734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance d2e7d814-bd0b-45f6-b1e4-59e24398fa95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a12612d5-83d4-4f3d-bf19-892f07886cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 17:05:06 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:05:07 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 17:05:07 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 17:05:07 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:05:07 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:05:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:05:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:05:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 17:05:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 17:05:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 17:05:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:05:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:05:30 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-changed-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.compute.manager [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Refreshing instance network info cache due to event network-changed-222466b9-1077-4286-a384-e20478d68c1a. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] Acquiring lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] Acquired lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Refreshing network info cache for port 222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:38 user nova-compute[73450]: INFO nova.compute.manager [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Terminating instance
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updated VIF entry in instance network info cache for port 222466b9-1077-4286-a384-e20478d68c1a. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.network.neutron [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating instance_info_cache with network_info: [{"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:05:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-196b5553-e715-4935-ae27-a74003df28f8 req-04124155-0a67-4f54-8ad7-e19e31ea8187 service nova] Releasing lock "refresh_cache-d2e7d814-bd0b-45f6-b1e4-59e24398fa95" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:05:38 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Instance destroyed successfully.
Aug 16 17:05:38 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lazy-loading 'resources' on Instance uuid d2e7d814-bd0b-45f6-b1e4-59e24398fa95 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1685193865',display_name='tempest-TestVolumeBootPattern-server-1685193865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1685193865',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILRNEuylwQ0VnIGw0nirA+N3UKc0I6qyiVseMYoSJ0D/xu2nSxg3lBiV4oetOhsFsVTkLNUOK6DLwxy7IbFSL1BD/Omf0N7OfiARFGUyObWHbQQznkxFuGGSoCG1OJJng==',key_name='tempest-TestVolumeBootPattern-1140755193',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3b953d82d634106aa0fb9574fafdc0d',ramdisk_id='',reservation_id='r-15hhtq4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-717711848',owner_user_name='tempest-TestVolumeBootPattern-717711848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:00:33Z,user_data=None,user_id='8c95d246b43b45b4963f9d750ae89fbd',uuid=d2e7d814-bd0b-45f6-b1e4-59e24398fa95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converting VIF {"id": "222466b9-1077-4286-a384-e20478d68c1a", "address": "fa:16:3e:21:1e:98", "network": {"id": "61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1810106979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3b953d82d634106aa0fb9574fafdc0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222466b9-10", "ovs_interfaceid": "222466b9-1077-4286-a384-e20478d68c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_vif [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap222466b9-10, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:05:39 user nova-compute[73450]: INFO os_vif [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=222466b9-1077-4286-a384-e20478d68c1a,network=Network(61dd2bf0-d7a9-49ff-9f05-d1cf613bbc14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222466b9-10')
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrNaovBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:05:39 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54a3d5-1f18-4d2c-ad17-54c42184b0e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b024c46-38ab-4207-a07d-d53ec9b080b4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:05:39 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:05:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc (non-flash)
Aug 16 17:05:39 user nova-compute[73450]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:05:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2800d8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc'): ({'sdd'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Removing single pathed devices sdd {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4498de02-5c38-4a95-a506-72787d087487]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6cfd38-2e3a-4f4c-84e7-47dbd93efd02]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Flushing IO for device /dev/sdd {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a6b35e-af86-47bf-b25b-22488bbde5a2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f056e67-1fc6-42ed-aa8c-83d929721b73]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] SCSI volumes sdd have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b9e533a3', '/dev/disk/by-id/scsi-1SCST_BIOb9e533a3-2a148d97ebe6e183', '/dev/disk/by-id/scsi-23261313438643937') {{(pid=84237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4283e6e-de24-4e9c-a3da-fcededcbdf6d]: (4, None) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ec05c0-0d98-4e41-ad46-b10f45d87c66]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b377c-51c4-4793-8cac-b9c596a1cbf2]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260]
Aug 16 17:05:39 user nova-compute[73450]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc, portal: 172.16.0.220,3260] successful.
Aug 16 17:05:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b3212d-3717-4356-bc68-29ec6e56effc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b061235c-cb04-4b52-ace0-ce8fa9ee2b9a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] <== disconnect_volume: return (305ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:05:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Deleting instance files /opt/stack/data/nova/instances/d2e7d814-bd0b-45f6-b1e4-59e24398fa95_del
Aug 16 17:05:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Deletion of /opt/stack/data/nova/instances/d2e7d814-bd0b-45f6-b1e4-59e24398fa95_del complete
Aug 16 17:05:39 user nova-compute[73450]: INFO nova.compute.manager [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 16 17:05:39 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:39 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:05:39 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Took 0.53 seconds to deallocate network for instance.
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:40 user nova-compute[73450]: INFO nova.compute.manager [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Detaching volume 63c35cd8-3660-45b7-bd16-813de59662cb
Aug 16 17:05:40 user nova-compute[73450]: INFO nova.virt.block_device [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Attempting to driver detach volume 63c35cd8-3660-45b7-bd16-813de59662cb from mountpoint /dev/vdb
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Attempting to detach device vdb from instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:05:40 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:05:40 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:05:40 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:05:40 user nova-compute[73450]:   <serial>63c35cd8-3660-45b7-bd16-813de59662cb</serial>
Aug 16 17:05:40 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:05:40 user nova-compute[73450]: </disk>
Aug 16 17:05:40 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:05:40 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully detached device vdb from instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 from the persistent domain config.
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:05:40 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:05:40 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:05:40 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:05:40 user nova-compute[73450]:   <serial>63c35cd8-3660-45b7-bd16-813de59662cb</serial>
Aug 16 17:05:40 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:05:40 user nova-compute[73450]: </disk>
Aug 16 17:05:40 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-vif-unplugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] No waiting events found dispatching network-vif-unplugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-vif-unplugged-222466b9-1077-4286-a384-e20478d68c1a for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] Acquiring lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] No waiting events found dispatching network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:05:40 user nova-compute[73450]: WARNING nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received unexpected event network-vif-plugged-222466b9-1077-4286-a384-e20478d68c1a for instance with vm_state active and task_state deleting.
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.manager [req-77632548-dad3-406d-b86c-406a6e9f87f6 req-dc8cf7d3-cd0a-4562-99c5-36c5e2452eb1 service nova] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Received event network-vif-deleted-222466b9-1077-4286-a384-e20478d68c1a {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205540.6389184, 52a40134-ade0-4c24-9f7d-7840b9fb8593 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:05:40 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully detached device vdb from instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 from the live domain config.
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srtGSAeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:05:40 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f2472a-2ed2-4a05-8415-ca78c8af9b20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f9a33-8939-454d-8eb9-cf8e466d91f9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:05:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb (non-flash)
Aug 16 17:05:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270195630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[188e34b9-e9db-40d1-88e0-5044e0f26baa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: INFO nova.compute.manager [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Took 0.79 seconds to detach 1 volumes for instance.
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[737ee1bf-c6aa-4bbb-a12e-aa63216d5021]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386ff2e-56c3-47db-8a9a-b1a35bf9f6c9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f14e67-28fb-415c-a8e0-7e4365181cd5]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[016afe64-48ab-49c9-a4a8-ea26400a93f6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ff9fe-7b6d-4ec3-9282-a67676cfd2f8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260]
Aug 16 17:05:40 user nova-compute[73450]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb, portal: 172.16.0.220,3260] successful.
Aug 16 17:05:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c35cd8-3660-45b7-bd16-813de59662cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20459f-b3f8-4991-bfcf-8017df7028e9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== disconnect_volume: return (276ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:05:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:41 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Deleted allocations for instance d2e7d814-bd0b-45f6-b1e4-59e24398fa95
Aug 16 17:05:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d769e54a-036f-42d3-a9f9-667e64feea30 tempest-TestVolumeBootPattern-717711848 tempest-TestVolumeBootPattern-717711848-project-member] Lock "d2e7d814-bd0b-45f6-b1e4-59e24398fa95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.847s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-changed-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG nova.compute.manager [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Refreshing instance network info cache due to event network-changed-5e09f50e-da33-40bf-bf8b-eb5e3c725c48. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG nova.network.neutron [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Refreshing network info cache for port 5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG nova.objects.instance [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:05:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-decebed7-174c-4455-920f-84ada8226e70 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:42 user nova-compute[73450]: DEBUG nova.network.neutron [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated VIF entry in instance network info cache for port 5e09f50e-da33-40bf-bf8b-eb5e3c725c48. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:05:42 user nova-compute[73450]: DEBUG nova.network.neutron [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:05:42 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-7d6c3dc0-ecc6-4932-a93a-0afa2013eed0 req-d90196f9-2d1f-41a3-9825-eee76c0821b8 service nova] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-changed-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Refreshing instance network info cache due to event network-changed-5307acd5-298d-44ee-9114-1ab118ae9931. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] Acquiring lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] Acquired lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.network.neutron [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Refreshing network info cache for port 5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'flavor' on Instance uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:05:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Ignoring supplied device name: /dev/vdb
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:43 user nova-compute[73450]: INFO nova.compute.manager [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Attaching volume cf030760-1a4f-4476-9e79-5204332113a2 to /dev/vdb
Aug 16 17:05:43 user nova-compute[73450]: DEBUG os_brick.utils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1b96b2-6f69-4a62-8d59-19f29e9e8fb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[824a10bc-bf1b-4bed-90ff-ebca4d8d0667]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.network.neutron [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updated VIF entry in instance network info cache for port 5307acd5-298d-44ee-9114-1ab118ae9931. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.network.neutron [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updating instance_info_cache with network_info: [{"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab285e-a6ef-4766-aa71-39ca3a677bd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0119102-b0d8-4e09-95e9-e38fe20e84ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-3647ac10-6a3e-4279-a378-59b111304a77 req-fedb18ed-26b6-4c0e-a97c-f0ccfb4bc749 service nova] Releasing lock "refresh_cache-a12612d5-83d4-4f3d-bf19-892f07886cdc" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:05:43 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:05:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af414d7f-c73d-4681-a788-aa89d24f6a7d]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG os_brick.utils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:05:43 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updating existing volume attachment record: ebf9f71e-ac22-4ec2-a925-5351d17da729 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:05:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMxTYRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:05:53 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:05:53 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:05:53 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cee43c-9a52-4240-a82e-cf1f999c41ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:05:53 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a18fd-75af-4937-9645-194f1e215e34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2] added
Aug 16 17:05:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04a4842-9a69-493e-ab2a-f1ae25addbae]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[faae8218-c0b5-4568-b54f-a27a51bc4c81]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FMxTYRXv {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FMxTYRXv" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c5b009-10f1-49db-be23-0bc9be77f847]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FMxTYRXv'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca452e-032b-403a-9504-6d632957238c]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23b1744-7b0a-44cc-a197-070e678e0c1e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:05:53 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:05:53 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:05:53 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:05:53 user nova-compute[73450]: 
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc6c91-20b5-4e85-9a7b-4ae746c1e2a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260]
Aug 16 17:05:53 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260] successful.
Aug 16 17:05:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a6d4c3-fedb-443b-b430-98d382d31186]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[88abcebd-a150-498a-bce9-66a3c8c3779a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 (non-flash)
Aug 16 17:05:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 (non-flash)
Aug 16 17:05:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e75f71-ca24-4610-9a2e-6568c87f78ec]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMxTYRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:05:53 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205538.9794636, d2e7d814-bd0b-45f6-b1e4-59e24398fa95 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:05:53 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] VM Stopped (Lifecycle Event)
Aug 16 17:05:54 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d86c5683-7737-482c-b15d-b1729f2a18a9 None None] [instance: d2e7d814-bd0b-45f6-b1e4-59e24398fa95] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:05:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:05:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23762363837646238', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:05:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363837646238', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:05:54 user nova-compute[73450]: DEBUG nova.objects.instance [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'flavor' on Instance uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:05:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:05:54 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:05:54 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:05:54 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:05:54 user nova-compute[73450]:   <serial>cf030760-1a4f-4476-9e79-5204332113a2</serial>
Aug 16 17:05:54 user nova-compute[73450]: </disk>
Aug 16 17:05:54 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:05:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:05:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:05:55 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No VIF found with MAC fa:16:3e:22:35:a7, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:05:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-a3b18b44-c721-44a7-aaee-c1eb10165cbb tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.655s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Triggering sync for uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:05:59 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:06:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:06:07 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:06:07 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8463MB free_disk=23.888980865478516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 52a40134-ade0-4c24-9f7d-7840b9fb8593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance a12612d5-83d4-4f3d-bf19-892f07886cdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:06:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:06:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:06:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:06:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:06:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:06:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:30 user nova-compute[73450]: INFO nova.compute.manager [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Terminating instance
Aug 16 17:06:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-808bf66a-8752-4445-af7a-bcc7cf85c32e req-cdab4db9-3afd-4fed-8f78-35c8a934d5ef service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-vif-unplugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-808bf66a-8752-4445-af7a-bcc7cf85c32e req-cdab4db9-3afd-4fed-8f78-35c8a934d5ef service nova] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-808bf66a-8752-4445-af7a-bcc7cf85c32e req-cdab4db9-3afd-4fed-8f78-35c8a934d5ef service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-808bf66a-8752-4445-af7a-bcc7cf85c32e req-cdab4db9-3afd-4fed-8f78-35c8a934d5ef service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-808bf66a-8752-4445-af7a-bcc7cf85c32e req-cdab4db9-3afd-4fed-8f78-35c8a934d5ef service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] No waiting events found dispatching network-vif-unplugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:06:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-808bf66a-8752-4445-af7a-bcc7cf85c32e req-cdab4db9-3afd-4fed-8f78-35c8a934d5ef service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-vif-unplugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:06:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Instance destroyed successfully.
Aug 16 17:06:31 user nova-compute[73450]: DEBUG nova.objects.instance [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'resources' on Instance uuid 52a40134-ade0-4c24-9f7d-7840b9fb8593 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247374528',display_name='tempest-AttachVolumeNegativeTest-server-1247374528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247374528',id=42,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXq7wRySKTQM9oErd3M+XhdUcSOuFL3Kw0FQ4d/lWMCY3tBP9mmU3Cyy4L3K0ZDEVJoWBLrAcnsvZEaI7LvFVf15ubiidyOfNNAYxxo6Itzb61vAIaxktqLJgFqWdV3aA==',key_name='tempest-keypair-1443295644',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-vt0x9d8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=52a40134-ade0-4c24-9f7d-7840b9fb8593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "address": "fa:16:3e:c7:1c:d5", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24ac7cff-6c", "ovs_interfaceid": "24ac7cff-6cf8-410f-87e1-aef0895ad5b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG os_vif [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24ac7cff-6c, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:06:31 user nova-compute[73450]: INFO os_vif [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=24ac7cff-6cf8-410f-87e1-aef0895ad5b1,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24ac7cff-6c')
Aug 16 17:06:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Deleting instance files /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593_del
Aug 16 17:06:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Deletion of /opt/stack/data/nova/instances/52a40134-ade0-4c24-9f7d-7840b9fb8593_del complete
Aug 16 17:06:31 user nova-compute[73450]: INFO nova.compute.manager [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 17:06:31 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:06:31 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:06:32 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Took 0.98 seconds to deallocate network for instance.
Aug 16 17:06:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-d05e7b90-57d4-4473-b1a4-af6b92fd81af req-4727469f-f492-4a20-a46e-bf3d15095ca8 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-vif-deleted-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:32 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Deleted allocations for instance 52a40134-ade0-4c24-9f7d-7840b9fb8593
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-235a77ea-c862-4883-912f-e1472c9a1a99 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-939f0c2b-5d23-4a69-9c87-34ea58846155 req-d8a0052f-9b09-4a7f-a05b-27d256bb0dd0 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received event network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-939f0c2b-5d23-4a69-9c87-34ea58846155 req-d8a0052f-9b09-4a7f-a05b-27d256bb0dd0 service nova] Acquiring lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-939f0c2b-5d23-4a69-9c87-34ea58846155 req-d8a0052f-9b09-4a7f-a05b-27d256bb0dd0 service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-939f0c2b-5d23-4a69-9c87-34ea58846155 req-d8a0052f-9b09-4a7f-a05b-27d256bb0dd0 service nova] Lock "52a40134-ade0-4c24-9f7d-7840b9fb8593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-939f0c2b-5d23-4a69-9c87-34ea58846155 req-d8a0052f-9b09-4a7f-a05b-27d256bb0dd0 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] No waiting events found dispatching network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:06:32 user nova-compute[73450]: WARNING nova.compute.manager [req-939f0c2b-5d23-4a69-9c87-34ea58846155 req-d8a0052f-9b09-4a7f-a05b-27d256bb0dd0 service nova] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Received unexpected event network-vif-plugged-24ac7cff-6cf8-410f-87e1-aef0895ad5b1 for instance with vm_state deleted and task_state None.
Aug 16 17:06:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:43 user nova-compute[73450]: INFO nova.compute.manager [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Detaching volume cf030760-1a4f-4476-9e79-5204332113a2
Aug 16 17:06:43 user nova-compute[73450]: INFO nova.virt.block_device [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Attempting to driver detach volume cf030760-1a4f-4476-9e79-5204332113a2 from mountpoint /dev/vdb
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Attempting to detach device vdb from instance a12612d5-83d4-4f3d-bf19-892f07886cdc from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:06:43 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:06:43 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:06:43 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:06:43 user nova-compute[73450]:   <serial>cf030760-1a4f-4476-9e79-5204332113a2</serial>
Aug 16 17:06:43 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:06:43 user nova-compute[73450]: </disk>
Aug 16 17:06:43 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:06:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully detached device vdb from instance a12612d5-83d4-4f3d-bf19-892f07886cdc from the persistent domain config.
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a12612d5-83d4-4f3d-bf19-892f07886cdc from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:06:43 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:06:43 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:06:43 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:06:43 user nova-compute[73450]:   <serial>cf030760-1a4f-4476-9e79-5204332113a2</serial>
Aug 16 17:06:43 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:06:43 user nova-compute[73450]: </disk>
Aug 16 17:06:43 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205603.7417786, a12612d5-83d4-4f3d-bf19-892f07886cdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:06:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully detached device vdb from instance a12612d5-83d4-4f3d-bf19-892f07886cdc from the live domain config.
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMxTYRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:06:43 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b2cbd-a751-4f64-8fb4-080565b2288d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567e2a7-fb76-4a64-b713-b5702b3fb2f3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 (non-flash)
Aug 16 17:06:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 (non-flash)
Aug 16 17:06:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe25060a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf62783-cecb-45b1-b69b-88a0f2d06fd6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa327a80-b0e3-4e0c-b2fd-09aa53666d2b]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[de82cfa0-3e23-49fe-b24b-37e9ca935079]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3d523e-4e62-4bdc-86f9-658681e8074c]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567ff03-2548-413f-8aa2-377d66b0bfe9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.033s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49aaf8-4379-45f1-9861-9ac50571b59e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260]
Aug 16 17:06:43 user nova-compute[73450]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2, portal: 172.16.0.220,3260] successful.
Aug 16 17:06:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[636fb4a4-309d-4c08-9437-668f92f2c76d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.236s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== disconnect_volume: return (237ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:06:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'flavor' on Instance uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-658bc19d-ab2b-4435-9331-9b445016cf61 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.602s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.473s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:44 user nova-compute[73450]: INFO nova.compute.manager [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Terminating instance
Aug 16 17:06:44 user nova-compute[73450]: DEBUG nova.compute.manager [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Instance destroyed successfully.
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'resources' on Instance uuid a12612d5-83d4-4f3d-bf19-892f07886cdc {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1715631814',display_name='tempest-VolumesSnapshotTestJSON-instance-1715631814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1715631814',id=46,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrw89w9i7s7OTKGuT7paQ3h4cHKUGnpYcWj+bDG7uvvwzwwdDBKsOhhYz88B1c1pBa6rlqXNuo2DQ49LuCuKN7hcjoPoQADRy4ENCV2HELxoEO6G+HpYz8l+oqFOa3/Jg==',key_name='tempest-keypair-324166830',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='436aa2ca57fd4043aaa97b006f85c3dd',ramdisk_id='',reservation_id='r-6dr46r7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1425912104',owner_user_name='tempest-VolumesSnapshotTestJSON-1425912104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b7113acfc8d4d5296c710263ce33f08',uuid=a12612d5-83d4-4f3d-bf19-892f07886cdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converting VIF {"id": "5307acd5-298d-44ee-9114-1ab118ae9931", "address": "fa:16:3e:22:35:a7", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5307acd5-29", "ovs_interfaceid": "5307acd5-298d-44ee-9114-1ab118ae9931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_vif [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5307acd5-29, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:06:45 user nova-compute[73450]: INFO os_vif [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:35:a7,bridge_name='br-int',has_traffic_filtering=True,id=5307acd5-298d-44ee-9114-1ab118ae9931,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5307acd5-29')
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMxTYRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:06:45 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf030760-1a4f-4476-9e79-5204332113a2', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb0ea5-e473-4cbe-aea8-d69c87474153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:45 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 16 17:06:45 user nova-compute[73450]: 
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b9137-42e4-4e1c-95d9-7f3b44f72826]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:06:45 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:06:45 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:06:45 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:06:45 user nova-compute[73450]: 
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe280026440>, {}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Disconnecting from: [] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== disconnect_volume: return (45ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:06:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Deleting instance files /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc_del
Aug 16 17:06:45 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Deletion of /opt/stack/data/nova/instances/a12612d5-83d4-4f3d-bf19-892f07886cdc_del complete
Aug 16 17:06:45 user nova-compute[73450]: INFO nova.compute.manager [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-d55b0f5f-3d81-4eb8-b8e2-d172f7411a30 req-c6153749-39e6-40d2-9a7a-b41eaf3d16fa service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-vif-unplugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d55b0f5f-3d81-4eb8-b8e2-d172f7411a30 req-c6153749-39e6-40d2-9a7a-b41eaf3d16fa service nova] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d55b0f5f-3d81-4eb8-b8e2-d172f7411a30 req-c6153749-39e6-40d2-9a7a-b41eaf3d16fa service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d55b0f5f-3d81-4eb8-b8e2-d172f7411a30 req-c6153749-39e6-40d2-9a7a-b41eaf3d16fa service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-d55b0f5f-3d81-4eb8-b8e2-d172f7411a30 req-c6153749-39e6-40d2-9a7a-b41eaf3d16fa service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] No waiting events found dispatching network-vif-unplugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:06:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-d55b0f5f-3d81-4eb8-b8e2-d172f7411a30 req-c6153749-39e6-40d2-9a7a-b41eaf3d16fa service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-vif-unplugged-5307acd5-298d-44ee-9114-1ab118ae9931 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:06:46 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205591.2245471, 52a40134-ade0-4c24-9f7d-7840b9fb8593 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:06:46 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] VM Stopped (Lifecycle Event)
Aug 16 17:06:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b0c2b8a8-d6ad-48d7-b576-ca75d0166382 None None] [instance: 52a40134-ade0-4c24-9f7d-7840b9fb8593] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:06:46 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:06:46 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Took 1.23 seconds to deallocate network for instance.
Aug 16 17:06:46 user nova-compute[73450]: DEBUG nova.compute.manager [req-d76ec526-f05d-47c4-a32c-0d4372c82103 req-733eace7-72ed-4f78-8af1-82b190879adc service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-vif-deleted-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:06:46 user nova-compute[73450]: WARNING nova.volume.cinder [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Attachment ebf9f71e-ac22-4ec2-a925-5351d17da729 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ebf9f71e-ac22-4ec2-a925-5351d17da729. (HTTP 404) (Request-ID: req-dbf27f26-0d49-48f4-8efe-c87b7198b21a)
Aug 16 17:06:46 user nova-compute[73450]: INFO nova.compute.manager [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 17:06:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:47 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Deleted allocations for instance a12612d5-83d4-4f3d-bf19-892f07886cdc
Aug 16 17:06:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-edb7c067-012d-4dd7-9762-2adccd2aff57 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-09e178f0-c4f6-48c9-a8d9-6841f7ef5361 req-2f8f4a4d-5473-4f07-8a5d-422b90245c61 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received event network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-09e178f0-c4f6-48c9-a8d9-6841f7ef5361 req-2f8f4a4d-5473-4f07-8a5d-422b90245c61 service nova] Acquiring lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-09e178f0-c4f6-48c9-a8d9-6841f7ef5361 req-2f8f4a4d-5473-4f07-8a5d-422b90245c61 service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-09e178f0-c4f6-48c9-a8d9-6841f7ef5361 req-2f8f4a4d-5473-4f07-8a5d-422b90245c61 service nova] Lock "a12612d5-83d4-4f3d-bf19-892f07886cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:06:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-09e178f0-c4f6-48c9-a8d9-6841f7ef5361 req-2f8f4a4d-5473-4f07-8a5d-422b90245c61 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] No waiting events found dispatching network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:06:47 user nova-compute[73450]: WARNING nova.compute.manager [req-09e178f0-c4f6-48c9-a8d9-6841f7ef5361 req-2f8f4a4d-5473-4f07-8a5d-422b90245c61 service nova] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Received unexpected event network-vif-plugged-5307acd5-298d-44ee-9114-1ab118ae9931 for instance with vm_state deleted and task_state None.
Aug 16 17:06:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:06:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205605.5260289, a12612d5-83d4-4f3d-bf19-892f07886cdc => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:07:00 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] VM Stopped (Lifecycle Event)
Aug 16 17:07:00 user nova-compute[73450]: DEBUG nova.compute.manager [None req-68a0d090-cd54-404f-a5ff-7de3ea86b0d5 None None] [instance: a12612d5-83d4-4f3d-bf19-892f07886cdc] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:07:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:07:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:07:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:07 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:07:07 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:07:07 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=23.94287109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:07:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:07:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:07:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:07:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:07:24 user nova-compute[73450]: INFO nova.compute.claims [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Claim successful on node user
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:07:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.policy [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e23eb33a56994696b7295fdfd0d04cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c0497e2014ad6a8b92a44097f4fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:07:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Creating image(s)
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.207s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk 1073741824" returned: 0 in 0.049s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Successfully created port: 79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Cannot resize image /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'migration_context' on Instance uuid 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Ensure instance console log exists: /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Successfully updated port: 79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquired lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-changed-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.compute.manager [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Refreshing instance network info cache due to event network-changed-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] Acquiring lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.neutron [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updating instance_info_cache with network_info: [{"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Releasing lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Instance network_info: |[{"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] Acquired lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Refreshing network info cache for port 79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Start _get_guest_xml network_info=[{"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:07:26 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:07:26 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1657262987',display_name='tempest-AttachVolumeNegativeTest-server-1657262987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1657262987',id=47,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGtDRVs1zSgCYMJsd65u1Ihn/L6dkhgtf3yMr2ca2InuRFvw5BgFi1XOrn6uNZutRFFlHiy6zY0rAkeOs4flJdlQmz3idwQTYxec65AltqV9LX69FceXP7PSZ3ckdks9g==',key_name='tempest-keypair-1870909103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-1hqt108m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=05f7254d-cd8d-431e-9b92-c2e4c1fe1a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.objects.instance [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:07:26 user nova-compute[73450]:   <uuid>05f7254d-cd8d-431e-9b92-c2e4c1fe1a33</uuid>
Aug 16 17:07:26 user nova-compute[73450]:   <name>instance-0000002f</name>
Aug 16 17:07:26 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:07:26 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:07:26 user nova-compute[73450]:   <metadata>
Aug 16 17:07:26 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:07:26 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:07:26 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1657262987</nova:name>
Aug 16 17:07:26 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:07:26</nova:creationTime>
Aug 16 17:07:26 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:07:26 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:07:26 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:07:26 user nova-compute[73450]:       <nova:owner>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:user uuid="e23eb33a56994696b7295fdfd0d04cac">tempest-AttachVolumeNegativeTest-1594829227-project-member</nova:user>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:project uuid="9b7c0497e2014ad6a8b92a44097f4fb7">tempest-AttachVolumeNegativeTest-1594829227</nova:project>
Aug 16 17:07:26 user nova-compute[73450]:       </nova:owner>
Aug 16 17:07:26 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:07:26 user nova-compute[73450]:       <nova:ports>
Aug 16 17:07:26 user nova-compute[73450]:         <nova:port uuid="79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6">
Aug 16 17:07:26 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 17:07:26 user nova-compute[73450]:         </nova:port>
Aug 16 17:07:26 user nova-compute[73450]:       </nova:ports>
Aug 16 17:07:26 user nova-compute[73450]:     </nova:instance>
Aug 16 17:07:26 user nova-compute[73450]:   </metadata>
Aug 16 17:07:26 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:07:26 user nova-compute[73450]:     <system>
Aug 16 17:07:26 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:07:26 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:07:26 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:07:26 user nova-compute[73450]:       <entry name="serial">05f7254d-cd8d-431e-9b92-c2e4c1fe1a33</entry>
Aug 16 17:07:26 user nova-compute[73450]:       <entry name="uuid">05f7254d-cd8d-431e-9b92-c2e4c1fe1a33</entry>
Aug 16 17:07:26 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:07:26 user nova-compute[73450]:     </system>
Aug 16 17:07:26 user nova-compute[73450]:   </sysinfo>
Aug 16 17:07:26 user nova-compute[73450]:   <os>
Aug 16 17:07:26 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:07:26 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:07:26 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:07:26 user nova-compute[73450]:   </os>
Aug 16 17:07:26 user nova-compute[73450]:   <features>
Aug 16 17:07:26 user nova-compute[73450]:     <acpi/>
Aug 16 17:07:26 user nova-compute[73450]:     <apic/>
Aug 16 17:07:26 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:07:26 user nova-compute[73450]:   </features>
Aug 16 17:07:26 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:07:26 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:07:26 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:07:26 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:07:26 user nova-compute[73450]:   </clock>
Aug 16 17:07:26 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:07:26 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:07:26 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:07:26 user nova-compute[73450]:   </cpu>
Aug 16 17:07:26 user nova-compute[73450]:   <devices>
Aug 16 17:07:26 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:07:26 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:07:26 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk"/>
Aug 16 17:07:26 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:07:26 user nova-compute[73450]:     </disk>
Aug 16 17:07:26 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:07:26 user nova-compute[73450]:       <mac address="fa:16:3e:ce:ae:35"/>
Aug 16 17:07:26 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:07:26 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:07:26 user nova-compute[73450]:       <target dev="tap79b0aa62-e3"/>
Aug 16 17:07:26 user nova-compute[73450]:     </interface>
Aug 16 17:07:26 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:07:26 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/console.log" append="off"/>
Aug 16 17:07:26 user nova-compute[73450]:     </serial>
Aug 16 17:07:26 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:07:26 user nova-compute[73450]:     <video>
Aug 16 17:07:26 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:07:26 user nova-compute[73450]:     </video>
Aug 16 17:07:26 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:07:26 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:07:26 user nova-compute[73450]:     </rng>
Aug 16 17:07:26 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:07:26 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:07:26 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:07:26 user nova-compute[73450]:     </memballoon>
Aug 16 17:07:26 user nova-compute[73450]:   </devices>
Aug 16 17:07:26 user nova-compute[73450]: </domain>
Aug 16 17:07:26 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1657262987',display_name='tempest-AttachVolumeNegativeTest-server-1657262987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1657262987',id=47,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGtDRVs1zSgCYMJsd65u1Ihn/L6dkhgtf3yMr2ca2InuRFvw5BgFi1XOrn6uNZutRFFlHiy6zY0rAkeOs4flJdlQmz3idwQTYxec65AltqV9LX69FceXP7PSZ3ckdks9g==',key_name='tempest-keypair-1870909103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-1hqt108m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=05f7254d-cd8d-431e-9b92-c2e4c1fe1a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG os_vif [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79b0aa62-e3, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79b0aa62-e3, col_values=(('external_ids', {'iface-id': '79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ae:35', 'vm-uuid': '05f7254d-cd8d-431e-9b92-c2e4c1fe1a33'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:26 user nova-compute[73450]: INFO os_vif [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3')
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:07:26 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:ce:ae:35, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:07:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updated VIF entry in instance network info cache for port 79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:07:27 user nova-compute[73450]: DEBUG nova.network.neutron [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updating instance_info_cache with network_info: [{"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:07:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-591b74c7-6ae5-4f20-8b30-fd3bc6086881 req-3ee78605-8490-418b-a920-60c61c085050 service nova] Releasing lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-260a2d44-7fb1-45f0-bf7b-e6df0c4809cc req-0995cd4c-8faa-4b80-8e38-988a444f7529 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-260a2d44-7fb1-45f0-bf7b-e6df0c4809cc req-0995cd4c-8faa-4b80-8e38-988a444f7529 service nova] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-260a2d44-7fb1-45f0-bf7b-e6df0c4809cc req-0995cd4c-8faa-4b80-8e38-988a444f7529 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-260a2d44-7fb1-45f0-bf7b-e6df0c4809cc req-0995cd4c-8faa-4b80-8e38-988a444f7529 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG nova.compute.manager [req-260a2d44-7fb1-45f0-bf7b-e6df0c4809cc req-0995cd4c-8faa-4b80-8e38-988a444f7529 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] No waiting events found dispatching network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:07:28 user nova-compute[73450]: WARNING nova.compute.manager [req-260a2d44-7fb1-45f0-bf7b-e6df0c4809cc req-0995cd4c-8faa-4b80-8e38-988a444f7529 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received unexpected event network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 for instance with vm_state building and task_state spawning.
Aug 16 17:07:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205650.1645367, 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] VM Resumed (Lifecycle Event)
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Instance spawned successfully.
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205650.1692972, 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] VM Started (Lifecycle Event)
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:07:30 user nova-compute[73450]: INFO nova.compute.manager [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Took 6.18 seconds to build instance.
Aug 16 17:07:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-54c8c6fe-a096-4dfa-aeb2-47f59313f1bc tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.278s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-07fb1178-9ed5-4d04-8ff7-5289ff72d982 req-b4b8e065-4ad3-4423-b56d-14e2d5239ea3 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-07fb1178-9ed5-4d04-8ff7-5289ff72d982 req-b4b8e065-4ad3-4423-b56d-14e2d5239ea3 service nova] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-07fb1178-9ed5-4d04-8ff7-5289ff72d982 req-b4b8e065-4ad3-4423-b56d-14e2d5239ea3 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-07fb1178-9ed5-4d04-8ff7-5289ff72d982 req-b4b8e065-4ad3-4423-b56d-14e2d5239ea3 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:30 user nova-compute[73450]: DEBUG nova.compute.manager [req-07fb1178-9ed5-4d04-8ff7-5289ff72d982 req-b4b8e065-4ad3-4423-b56d-14e2d5239ea3 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] No waiting events found dispatching network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:07:30 user nova-compute[73450]: WARNING nova.compute.manager [req-07fb1178-9ed5-4d04-8ff7-5289ff72d982 req-b4b8e065-4ad3-4423-b56d-14e2d5239ea3 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received unexpected event network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 for instance with vm_state active and task_state None.
Aug 16 17:07:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG nova.objects.instance [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'flavor' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:07:37 user nova-compute[73450]: INFO nova.compute.manager [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Attaching volume 9320937a-d98f-4246-bab8-f2ccb0d00b28 to /dev/vdb
Aug 16 17:07:37 user nova-compute[73450]: DEBUG os_brick.utils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64624ce-f606-46f1-90e1-daed8bebc2bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20466ec-7236-4677-bb7a-4da40c66eb59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95f85e-b7ec-4b98-a677-1ca5dceb46c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c727322-8d0e-41d1-9c5d-bc6dbe3d3a0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:07:38 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:07:38 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a7f002-6f45-4853-bdef-322dcbc13e2a]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG os_brick.utils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:07:38 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating existing volume attachment record: 1d15c346-c2cc-48bc-959f-511ab67ea05c {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:07:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:07:58 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:07:58 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:07:58 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a54613-45f8-44a7-b6ea-ddc6157f80a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:07:58 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d142965-a758-4850-8b49-e1a2b1218ddd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28] added
Aug 16 17:07:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7008cc5-f8dd-40d2-a028-0b55591df1c4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4406bb9-2754-45eb-8a59-74b30edab151]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnHpfYIU {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnHpfYIU" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8289384-c242-49ff-8e04-05282a93d2f0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnHpfYIU'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[71606fa9-f7c2-42f9-a190-1f6fd92c4792]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e01077-4f20-4918-a9f6-02d301ff5a00]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:07:58 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:07:58 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:07:58 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:07:58 user nova-compute[73450]: 
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6964cc7-7592-4887-8f74-5762301575a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]
Aug 16 17:07:58 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.
Aug 16 17:07:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b54cfbc-529b-499b-a06e-c473cc42e021]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c833959-8662-4756-ae85-5291657289c1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:07:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:07:58 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35c0b02-5f1e-414d-a24a-791a114b4ea6]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:07:58 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:07:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:07:59 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26430613032626135', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:07:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430613032626135', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:07:59 user nova-compute[73450]: DEBUG nova.objects.instance [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'flavor' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:07:59 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:07:59 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:07:59 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:07:59 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:07:59 user nova-compute[73450]:   <serial>9320937a-d98f-4246-bab8-f2ccb0d00b28</serial>
Aug 16 17:07:59 user nova-compute[73450]: </disk>
Aug 16 17:07:59 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:08:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:08:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:08:00 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No VIF found with MAC fa:16:3e:8b:89:8b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:08:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:00 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-433c84b6-6b6c-4a1e-a5d1-bb858fd31638 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.323s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Stashing vm_state: active {{(pid=73450) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'pci_requests' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:08:01 user nova-compute[73450]: INFO nova.compute.claims [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Claim successful on node user
Aug 16 17:08:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'resources' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:01 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'pci_devices' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:01 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating resource usage from migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e
Aug 16 17:08:02 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.243s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:02 user nova-compute[73450]: INFO nova.compute.manager [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Migrating
Aug 16 17:08:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Starting migrate_disk_and_power_off {{(pid=73450) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-f1f62b4b-2dde-49d1-bee9-0bcfe4b05785 req-c323930b-e146-423a-86e9-3c6dafda7336 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f1f62b4b-2dde-49d1-bee9-0bcfe4b05785 req-c323930b-e146-423a-86e9-3c6dafda7336 service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f1f62b4b-2dde-49d1-bee9-0bcfe4b05785 req-c323930b-e146-423a-86e9-3c6dafda7336 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f1f62b4b-2dde-49d1-bee9-0bcfe4b05785 req-c323930b-e146-423a-86e9-3c6dafda7336 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-f1f62b4b-2dde-49d1-bee9-0bcfe4b05785 req-c323930b-e146-423a-86e9-3c6dafda7336 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:08:03 user nova-compute[73450]: WARNING nova.compute.manager [req-f1f62b4b-2dde-49d1-bee9-0bcfe4b05785 req-c323930b-e146-423a-86e9-3c6dafda7336 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state active and task_state resize_migrating.
Aug 16 17:08:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:03 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance destroyed successfully.
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e09f50e-da, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:08:03 user nova-compute[73450]: INFO os_vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da')
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:08:03 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc85f77f-f3d7-4208-8aa0-b8aaeb060c52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd71b91-1752-4057-b1b3-16e249b6eeb9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:08:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:08:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270194700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7dfdcb-171e-48e3-9a76-8101b0a05a43]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69dc1ef-171e-47ad-a13d-4dd69c9d46f0]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa20bf04-f386-4009-b2b5-cc1bc18535cf]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a4a45-2955-4106-9cde-dbf5d14e9eb3]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae810a-8a1a-4cbe-86d2-e168d42575dc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f569608f-0938-4713-ba11-f5134ca8f51e]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]
Aug 16 17:08:03 user nova-compute[73450]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.
Aug 16 17:08:03 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2503a2c-7ccf-4a6c-8729-6db9aee8a229]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== disconnect_volume: return (256ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:08:03 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a_resize/disk /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "cp -r /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a_resize/disk /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk" returned: 0 in 0.226s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a_resize/disk.info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk.info {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:04 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "cp -r /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a_resize/disk.info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk.info" returned: 0 in 0.039s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-350f438a-651f-40d0-a2b2-818853ec6e3d req-c1472538-2089-4a19-84e5-fb116847df06 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-350f438a-651f-40d0-a2b2-818853ec6e3d req-c1472538-2089-4a19-84e5-fb116847df06 service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-350f438a-651f-40d0-a2b2-818853ec6e3d req-c1472538-2089-4a19-84e5-fb116847df06 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-350f438a-651f-40d0-a2b2-818853ec6e3d req-c1472538-2089-4a19-84e5-fb116847df06 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-350f438a-651f-40d0-a2b2-818853ec6e3d req-c1472538-2089-4a19-84e5-fb116847df06 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:08:05 user nova-compute[73450]: WARNING nova.compute.manager [req-350f438a-651f-40d0-a2b2-818853ec6e3d req-c1472538-2089-4a19-84e5-fb116847df06 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state active and task_state resize_migrating.
Aug 16 17:08:05 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Port 5e09f50e-da33-40bf-bf8b-eb5e3c725c48 binding to destination host user is already ACTIVE {{(pid=73450) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:08:05 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG os_brick.utils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3767c4dd-e4c2-47b4-b8d8-2f034bb6aefa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a69316b-699f-4162-85ff-ad150a293ecf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5319d4-096c-4f1b-a108-0a55fee270ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54a41b-b244-4629-b0c6-63b2c268f6fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:08:06 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:08:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5328b65d-1e2d-4500-bb5e-445d4f0719a6]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:08:06 user nova-compute[73450]: DEBUG os_brick.utils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:08:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:08 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:09 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:08:09 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=23.876083374023438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Applying migration context for instance e28e8532-9094-44ba-9069-d7af964ba11a as it has an incoming, in-progress migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e. Migration status is post-migrating {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 17:08:09 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating resource usage from migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=22GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:08:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:08:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:08:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:08:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:15 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:08:15 user nova-compute[73450]: INFO nova.compute.claims [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Claim successful on node user
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:08:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.policy [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b7113acfc8d4d5296c710263ce33f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436aa2ca57fd4043aaa97b006f85c3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:08:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Creating image(s)
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "/opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "/opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.189s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Starting finish_migration {{(pid=73450) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance directory exists: not creating {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 17:08:16 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Creating image(s)
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'trusted_certs' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.197s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk 1073741824" returned: 0 in 0.059s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk. size=21474836480 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Successfully created port: d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk 21474836480 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk 21474836480" returned: 0 in 0.055s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Ensure instance console log exists: /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start _get_guest_xml network_info=[{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '1824f35d-0a4e-4722-bf40-85ad121069c9', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e28e8532-9094-44ba-9069-d7af964ba11a', 'attached_at': '2023-08-16T17:08:16.000000', 'detached_at': '', 'volume_id': '9320937a-d98f-4246-bab8-f2ccb0d00b28', 'serial': '9320937a-d98f-4246-bab8-f2ccb0d00b28'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:08:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:08:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'vcpu_model' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Cannot resize image /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'migration_context' on Instance uuid 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:08:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:08:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:08:17 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Ensure instance console log exists: /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[514d99fd-ed1f-4d62-9c2c-c687f58ff23e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:08:17 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b343db3c-07d7-4643-a5b1-9538bbf20d81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28] added
Aug 16 17:08:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85b02f-0774-43ec-ad24-a2587340221a]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1f801c-2afd-4a68-a0f8-69543598b2f3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnHpfYIU {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnHpfYIU" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f21b0-11a6-4aa3-8c2d-c561897641c8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnHpfYIU'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[58956449-1c5a-496d-9fff-06c7c6723e68]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f0328-3b9c-4d10-a9d3-95b11a40a667]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:08:17 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:08:17 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:08:17 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:08:17 user nova-compute[73450]: 
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef327c-af8f-4b76-bb00-061f1718fe41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]
Aug 16 17:08:17 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.
Aug 16 17:08:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0b761a-424d-4864-9137-b950705d5b0e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[339243e8-a748-41aa-b42c-43b24dc94d98]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:08:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:08:17 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b5cbd-90d2-42b1-a879-865fd84ce3c3]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:08:17 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Successfully updated port: d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquired lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-changed-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.compute.manager [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Refreshing instance network info cache due to event network-changed-d1226183-cdc9-4b1b-b05d-9e47e2b69a52. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] Acquiring lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updating instance_info_cache with network_info: [{"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Releasing lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Instance network_info: |[{"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] Acquired lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Refreshing network info cache for port d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Start _get_guest_xml network_info=[{"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:08:18 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:08:18 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1811508103',display_name='tempest-VolumesSnapshotTestJSON-instance-1811508103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1811508103',id=48,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbQif8X4rurVSVqsOMPhsTyYVH0InKp3Dz+jdF8FHac/ptan5fve56aWYGGhDAMnuemJIytzTvd/s8fGIVEerGy26I1bgxPjMxT3d0w8/8+dX8Hm77Ghuuv1ljiVFLsPg==',key_name='tempest-keypair-1592645125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='436aa2ca57fd4043aaa97b006f85c3dd',ramdisk_id='',reservation_id='r-23d393wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1425912104',owner_user_name='tempest-VolumesSnapshotTestJSON-1425912104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b7113acfc8d4d5296c710263ce33f08',uuid=5c27eb33-5d49-41f4-8485-c9f21537bb5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converting VIF {"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.objects.instance [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:08:18 user nova-compute[73450]:   <uuid>5c27eb33-5d49-41f4-8485-c9f21537bb5a</uuid>
Aug 16 17:08:18 user nova-compute[73450]:   <name>instance-00000030</name>
Aug 16 17:08:18 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:08:18 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:08:18 user nova-compute[73450]:   <metadata>
Aug 16 17:08:18 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:08:18 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1811508103</nova:name>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:08:18</nova:creationTime>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:08:18 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:08:18 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:owner>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:user uuid="1b7113acfc8d4d5296c710263ce33f08">tempest-VolumesSnapshotTestJSON-1425912104-project-member</nova:user>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:project uuid="436aa2ca57fd4043aaa97b006f85c3dd">tempest-VolumesSnapshotTestJSON-1425912104</nova:project>
Aug 16 17:08:18 user nova-compute[73450]:       </nova:owner>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:ports>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:port uuid="d1226183-cdc9-4b1b-b05d-9e47e2b69a52">
Aug 16 17:08:18 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 17:08:18 user nova-compute[73450]:         </nova:port>
Aug 16 17:08:18 user nova-compute[73450]:       </nova:ports>
Aug 16 17:08:18 user nova-compute[73450]:     </nova:instance>
Aug 16 17:08:18 user nova-compute[73450]:   </metadata>
Aug 16 17:08:18 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:08:18 user nova-compute[73450]:     <system>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="serial">5c27eb33-5d49-41f4-8485-c9f21537bb5a</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="uuid">5c27eb33-5d49-41f4-8485-c9f21537bb5a</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:08:18 user nova-compute[73450]:     </system>
Aug 16 17:08:18 user nova-compute[73450]:   </sysinfo>
Aug 16 17:08:18 user nova-compute[73450]:   <os>
Aug 16 17:08:18 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:08:18 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:08:18 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:08:18 user nova-compute[73450]:   </os>
Aug 16 17:08:18 user nova-compute[73450]:   <features>
Aug 16 17:08:18 user nova-compute[73450]:     <acpi/>
Aug 16 17:08:18 user nova-compute[73450]:     <apic/>
Aug 16 17:08:18 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:08:18 user nova-compute[73450]:   </features>
Aug 16 17:08:18 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:08:18 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:08:18 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:08:18 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:08:18 user nova-compute[73450]:   </clock>
Aug 16 17:08:18 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:08:18 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:08:18 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:08:18 user nova-compute[73450]:   </cpu>
Aug 16 17:08:18 user nova-compute[73450]:   <devices>
Aug 16 17:08:18 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:08:18 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:08:18 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk"/>
Aug 16 17:08:18 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:     </disk>
Aug 16 17:08:18 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:08:18 user nova-compute[73450]:       <mac address="fa:16:3e:bb:a2:08"/>
Aug 16 17:08:18 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:08:18 user nova-compute[73450]:       <target dev="tapd1226183-cd"/>
Aug 16 17:08:18 user nova-compute[73450]:     </interface>
Aug 16 17:08:18 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:08:18 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/console.log" append="off"/>
Aug 16 17:08:18 user nova-compute[73450]:     </serial>
Aug 16 17:08:18 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:08:18 user nova-compute[73450]:     <video>
Aug 16 17:08:18 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:     </video>
Aug 16 17:08:18 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:08:18 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:08:18 user nova-compute[73450]:     </rng>
Aug 16 17:08:18 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:08:18 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:08:18 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:08:18 user nova-compute[73450]:     </memballoon>
Aug 16 17:08:18 user nova-compute[73450]:   </devices>
Aug 16 17:08:18 user nova-compute[73450]: </domain>
Aug 16 17:08:18 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1811508103',display_name='tempest-VolumesSnapshotTestJSON-instance-1811508103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1811508103',id=48,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbQif8X4rurVSVqsOMPhsTyYVH0InKp3Dz+jdF8FHac/ptan5fve56aWYGGhDAMnuemJIytzTvd/s8fGIVEerGy26I1bgxPjMxT3d0w8/8+dX8Hm77Ghuuv1ljiVFLsPg==',key_name='tempest-keypair-1592645125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='436aa2ca57fd4043aaa97b006f85c3dd',ramdisk_id='',reservation_id='r-23d393wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1425912104',owner_user_name='tempest-VolumesSnapshotTestJSON-1425912104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b7113acfc8d4d5296c710263ce33f08',uuid=5c27eb33-5d49-41f4-8485-c9f21537bb5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converting VIF {"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG os_vif [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1226183-cd, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1226183-cd, col_values=(('external_ids', {'iface-id': 'd1226183-cdc9-4b1b-b05d-9e47e2b69a52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:a2:08', 'vm-uuid': '5c27eb33-5d49-41f4-8485-c9f21537bb5a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: INFO os_vif [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd')
Aug 16 17:08:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26430613032626135', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430613032626135', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205683.5314348, e28e8532-9094-44ba-9069-d7af964ba11a => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:08:18 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Stopped (Lifecycle Event)
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-94016fbf-4e21-43ed-9e73-26b72b781838 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:08:18 user nova-compute[73450]:   <uuid>e28e8532-9094-44ba-9069-d7af964ba11a</uuid>
Aug 16 17:08:18 user nova-compute[73450]:   <name>instance-0000002d</name>
Aug 16 17:08:18 user nova-compute[73450]:   <memory>2097152</memory>
Aug 16 17:08:18 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:08:18 user nova-compute[73450]:   <metadata>
Aug 16 17:08:18 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:08:18 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherB-server-877252721</nova:name>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:08:17</nova:creationTime>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:flavor name="m1.small">
Aug 16 17:08:18 user nova-compute[73450]:         <nova:memory>2048</nova:memory>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:disk>20</nova:disk>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:08:18 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:owner>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:user uuid="4a86e84a3c404ab6af0794f17a8d4ef3">tempest-ServerActionsTestOtherB-616819457-project-member</nova:user>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:project uuid="79240e658cc64592aba46bb80975c127">tempest-ServerActionsTestOtherB-616819457</nova:project>
Aug 16 17:08:18 user nova-compute[73450]:       </nova:owner>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:08:18 user nova-compute[73450]:       <nova:ports>
Aug 16 17:08:18 user nova-compute[73450]:         <nova:port uuid="5e09f50e-da33-40bf-bf8b-eb5e3c725c48">
Aug 16 17:08:18 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 17:08:18 user nova-compute[73450]:         </nova:port>
Aug 16 17:08:18 user nova-compute[73450]:       </nova:ports>
Aug 16 17:08:18 user nova-compute[73450]:     </nova:instance>
Aug 16 17:08:18 user nova-compute[73450]:   </metadata>
Aug 16 17:08:18 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:08:18 user nova-compute[73450]:     <system>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="serial">e28e8532-9094-44ba-9069-d7af964ba11a</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="uuid">e28e8532-9094-44ba-9069-d7af964ba11a</entry>
Aug 16 17:08:18 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:08:18 user nova-compute[73450]:     </system>
Aug 16 17:08:18 user nova-compute[73450]:   </sysinfo>
Aug 16 17:08:18 user nova-compute[73450]:   <os>
Aug 16 17:08:18 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:08:18 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:08:18 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:08:18 user nova-compute[73450]:   </os>
Aug 16 17:08:18 user nova-compute[73450]:   <features>
Aug 16 17:08:18 user nova-compute[73450]:     <acpi/>
Aug 16 17:08:18 user nova-compute[73450]:     <apic/>
Aug 16 17:08:18 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:08:18 user nova-compute[73450]:   </features>
Aug 16 17:08:18 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:08:18 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:08:18 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:08:18 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:08:18 user nova-compute[73450]:   </clock>
Aug 16 17:08:18 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:08:18 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:08:18 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:08:18 user nova-compute[73450]:   </cpu>
Aug 16 17:08:18 user nova-compute[73450]:   <devices>
Aug 16 17:08:18 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:08:18 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:08:18 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk"/>
Aug 16 17:08:18 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:     </disk>
Aug 16 17:08:18 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 17:08:18 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:08:18 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 17:08:18 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:       <serial>9320937a-d98f-4246-bab8-f2ccb0d00b28</serial>
Aug 16 17:08:18 user nova-compute[73450]:     </disk>
Aug 16 17:08:18 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:08:18 user nova-compute[73450]:       <mac address="fa:16:3e:8b:89:8b"/>
Aug 16 17:08:18 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:08:18 user nova-compute[73450]:       <target dev="tap5e09f50e-da"/>
Aug 16 17:08:18 user nova-compute[73450]:     </interface>
Aug 16 17:08:18 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:08:18 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/console.log" append="off"/>
Aug 16 17:08:18 user nova-compute[73450]:     </serial>
Aug 16 17:08:18 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:08:18 user nova-compute[73450]:     <video>
Aug 16 17:08:18 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:08:18 user nova-compute[73450]:     </video>
Aug 16 17:08:18 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:08:18 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:08:18 user nova-compute[73450]:     </rng>
Aug 16 17:08:18 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:08:18 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:08:18 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:08:18 user nova-compute[73450]:     </memballoon>
Aug 16 17:08:18 user nova-compute[73450]:   </devices>
Aug 16 17:08:18 user nova-compute[73450]: </domain>
Aug 16 17:08:18 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-150721346-network", "vif_mac": "fa:16:3e:8b:89:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG os_vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-94016fbf-4e21-43ed-9e73-26b72b781838 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e09f50e-da, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e09f50e-da, col_values=(('external_ids', {'iface-id': '5e09f50e-da33-40bf-bf8b-eb5e3c725c48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:89:8b', 'vm-uuid': 'e28e8532-9094-44ba-9069-d7af964ba11a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No VIF found with MAC fa:16:3e:bb:a2:08, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:08:18 user nova-compute[73450]: INFO nova.compute.manager [None req-94016fbf-4e21-43ed-9e73-26b72b781838 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 17:08:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:18 user nova-compute[73450]: INFO os_vif [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da')
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] No VIF found with MAC fa:16:3e:8b:89:8b, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updated VIF entry in instance network info cache for port d1226183-cdc9-4b1b-b05d-9e47e2b69a52. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG nova.network.neutron [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updating instance_info_cache with network_info: [{"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:08:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-56efd073-9ada-4777-a860-495bb4d6a58d req-cb81e221-7099-4926-bea6-8cd1d6d02dfa service nova] Releasing lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG nova.compute.manager [req-70a094c4-1f87-424c-9f5f-770417902893 req-3b0d2055-2018-46b0-8341-ec7b26d7f1a3 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70a094c4-1f87-424c-9f5f-770417902893 req-3b0d2055-2018-46b0-8341-ec7b26d7f1a3 service nova] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70a094c4-1f87-424c-9f5f-770417902893 req-3b0d2055-2018-46b0-8341-ec7b26d7f1a3 service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-70a094c4-1f87-424c-9f5f-770417902893 req-3b0d2055-2018-46b0-8341-ec7b26d7f1a3 service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-70a094c4-1f87-424c-9f5f-770417902893 req-3b0d2055-2018-46b0-8341-ec7b26d7f1a3 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] No waiting events found dispatching network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:08:21 user nova-compute[73450]: WARNING nova.compute.manager [req-70a094c4-1f87-424c-9f5f-770417902893 req-3b0d2055-2018-46b0-8341-ec7b26d7f1a3 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received unexpected event network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 for instance with vm_state building and task_state spawning.
Aug 16 17:08:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-ddfd2ec1-626a-4bed-b9d2-b3eb6f0096e7 req-7b9b6bb4-97e5-4b8f-ab8c-47e284872c64 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddfd2ec1-626a-4bed-b9d2-b3eb6f0096e7 req-7b9b6bb4-97e5-4b8f-ab8c-47e284872c64 service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddfd2ec1-626a-4bed-b9d2-b3eb6f0096e7 req-7b9b6bb4-97e5-4b8f-ab8c-47e284872c64 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ddfd2ec1-626a-4bed-b9d2-b3eb6f0096e7 req-7b9b6bb4-97e5-4b8f-ab8c-47e284872c64 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-ddfd2ec1-626a-4bed-b9d2-b3eb6f0096e7 req-7b9b6bb4-97e5-4b8f-ab8c-47e284872c64 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:08:21 user nova-compute[73450]: WARNING nova.compute.manager [req-ddfd2ec1-626a-4bed-b9d2-b3eb6f0096e7 req-7b9b6bb4-97e5-4b8f-ab8c-47e284872c64 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state active and task_state resize_finish.
Aug 16 17:08:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-074535c6-6719-4ecf-9634-9827f1260af0 req-0ba87dfa-8cbd-4ec1-920f-4ef8b27e2d8e service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-074535c6-6719-4ecf-9634-9827f1260af0 req-0ba87dfa-8cbd-4ec1-920f-4ef8b27e2d8e service nova] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-074535c6-6719-4ecf-9634-9827f1260af0 req-0ba87dfa-8cbd-4ec1-920f-4ef8b27e2d8e service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-074535c6-6719-4ecf-9634-9827f1260af0 req-0ba87dfa-8cbd-4ec1-920f-4ef8b27e2d8e service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-074535c6-6719-4ecf-9634-9827f1260af0 req-0ba87dfa-8cbd-4ec1-920f-4ef8b27e2d8e service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] No waiting events found dispatching network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:08:23 user nova-compute[73450]: WARNING nova.compute.manager [req-074535c6-6719-4ecf-9634-9827f1260af0 req-0ba87dfa-8cbd-4ec1-920f-4ef8b27e2d8e service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received unexpected event network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 for instance with vm_state building and task_state spawning.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-31b9f326-5e0c-48c2-ba59-f3e5032c95f3 req-2260541c-7bb8-4f23-8269-ab255d5effcd service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-31b9f326-5e0c-48c2-ba59-f3e5032c95f3 req-2260541c-7bb8-4f23-8269-ab255d5effcd service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-31b9f326-5e0c-48c2-ba59-f3e5032c95f3 req-2260541c-7bb8-4f23-8269-ab255d5effcd service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-31b9f326-5e0c-48c2-ba59-f3e5032c95f3 req-2260541c-7bb8-4f23-8269-ab255d5effcd service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-31b9f326-5e0c-48c2-ba59-f3e5032c95f3 req-2260541c-7bb8-4f23-8269-ab255d5effcd service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:08:23 user nova-compute[73450]: WARNING nova.compute.manager [req-31b9f326-5e0c-48c2-ba59-f3e5032c95f3 req-2260541c-7bb8-4f23-8269-ab255d5effcd service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state active and task_state resize_finish.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205703.522532, e28e8532-9094-44ba-9069-d7af964ba11a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Resumed (Lifecycle Event)
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance running successfully.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Failed to set time: agent not configured {{(pid=73450) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-7aa5d8fa-7545-4633-9d7c-82017537124c tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] finish_migration finished successfully. {{(pid=73450) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Instance spawned successfully.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205703.5230007, e28e8532-9094-44ba-9069-d7af964ba11a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Started (Lifecycle Event)
Aug 16 17:08:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205703.5454998, 5c27eb33-5d49-41f4-8485-c9f21537bb5a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] VM Resumed (Lifecycle Event)
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205703.5459278, 5c27eb33-5d49-41f4-8485-c9f21537bb5a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] VM Started (Lifecycle Event)
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Took 7.36 seconds to spawn the instance on the hypervisor.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:08:23 user nova-compute[73450]: INFO nova.compute.manager [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Took 7.99 seconds to build instance.
Aug 16 17:08:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-21d588ac-1062-4e76-a5a7-6f98613e3397 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.080s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:08:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:08:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:08:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:08:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:08:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:08:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:08:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updating instance_info_cache with network_info: [{"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:09:05 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:10 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:09:10 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8405MB free_disk=23.845195770263672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Applying migration context for instance e28e8532-9094-44ba-9069-d7af964ba11a as it has an incoming, in-progress migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e. Migration status is finished {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 17:09:10 user nova-compute[73450]: INFO nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating resource usage from migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:09:10 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:09:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:09:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:09:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:09:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-changed-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:09:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Refreshing instance network info cache due to event network-changed-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:09:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] Acquiring lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:09:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] Acquired lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:09:15 user nova-compute[73450]: DEBUG nova.network.neutron [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Refreshing network info cache for port 79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:09:16 user nova-compute[73450]: DEBUG nova.network.neutron [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updated VIF entry in instance network info cache for port 79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:09:16 user nova-compute[73450]: DEBUG nova.network.neutron [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updating instance_info_cache with network_info: [{"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:09:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d57c6fd6-613c-43e3-bb14-1480cda1badc req-54a4a937-c5db-4ad4-a9f5-ff79b4bde6c6 service nova] Releasing lock "refresh_cache-05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:09:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:09:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:09:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:09:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG nova.objects.instance [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:19 user nova-compute[73450]: INFO nova.compute.manager [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Attaching volume 981130f7-d56f-46f8-81dc-27dd5768c38a to /dev/vdb
Aug 16 17:09:19 user nova-compute[73450]: DEBUG os_brick.utils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c43eb-e460-4cf8-b114-5801cfe5629f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c451af-a785-451d-967a-c6af833c15c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[18743b12-bbb6-41c8-9649-3d54c7b4b05d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8b87b3-dbf5-4d09-a311-c90cce5a000c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:09:19 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:09:19 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[106e8df3-3bb5-4d37-b7e1-7b5a6759cc08]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG os_brick.utils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:09:19 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updating existing volume attachment record: 9c4855c3-462b-4689-9cfa-f425e33575c3 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:09:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRbMJTCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:09:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:09:36 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:09:36 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[702fb7e4-95b5-40aa-b29e-0d41625e3600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:09:36 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d66cca6-9c48-4ea7-9d39-80782f9c848c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a] added
Aug 16 17:09:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ad38c-ed90-4ae0-832a-51f7e56870f9]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb30c2-9778-4384-8c14-c8e2c978177d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRbMJTCV {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRbMJTCV" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5626aa05-0213-4c7d-8a98-2748b4d290e0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lRbMJTCV'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ccc6f-9412-4cc4-ac38-b0d3642e5a1f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e612c4e1-5614-4698-b34f-c71bdcc2f9d4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb615b-b24e-465f-ae11-43d68c3c68ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260]
Aug 16 17:09:36 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260] successful.
Aug 16 17:09:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc8f864-f806-4d71-a332-eb95ab01a7ee]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f71073-fe5f-49b5-a336-8963bec9f3c0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:36 user nova-compute[73450]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a (non-flash)
Aug 16 17:09:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:36 user nova-compute[73450]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a (non-flash)
Aug 16 17:09:36 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5e1b9-8e46-44be-857d-c8b65a104c63]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:09:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRbMJTCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26361323165633237', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361323165633237', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG nova.objects.instance [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:09:37 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:09:37 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:09:37 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:09:37 user nova-compute[73450]:   <serial>981130f7-d56f-46f8-81dc-27dd5768c38a</serial>
Aug 16 17:09:37 user nova-compute[73450]: </disk>
Aug 16 17:09:37 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:09:37 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:ce:ae:35, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:09:38 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-93ffb690-1d42-42b1-8143-c3f7bd3f1b5d tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.337s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:39 user nova-compute[73450]: INFO nova.compute.manager [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Detaching volume 981130f7-d56f-46f8-81dc-27dd5768c38a
Aug 16 17:09:39 user nova-compute[73450]: INFO nova.virt.block_device [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Attempting to driver detach volume 981130f7-d56f-46f8-81dc-27dd5768c38a from mountpoint /dev/vdb
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Attempting to detach device vdb from instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:09:39 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:09:39 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:09:39 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:09:39 user nova-compute[73450]:   <serial>981130f7-d56f-46f8-81dc-27dd5768c38a</serial>
Aug 16 17:09:39 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:09:39 user nova-compute[73450]: </disk>
Aug 16 17:09:39 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:09:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully detached device vdb from instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 from the persistent domain config.
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:09:39 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:09:39 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:09:39 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:09:39 user nova-compute[73450]:   <serial>981130f7-d56f-46f8-81dc-27dd5768c38a</serial>
Aug 16 17:09:39 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:09:39 user nova-compute[73450]: </disk>
Aug 16 17:09:39 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205779.825236, 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:09:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully detached device vdb from instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 from the live domain config.
Aug 16 17:09:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRbMJTCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:09:39 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75753cee-86d0-416e-b949-42282ffd72be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[55938c20-810d-4d79-af69-da7a65e4baf6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:39 user nova-compute[73450]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a (non-flash)
Aug 16 17:09:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:39 user nova-compute[73450]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a (non-flash)
Aug 16 17:09:39 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2701325f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e925486-1a09-4aa9-98af-0a7135da201f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0839c5-bec7-4178-89ad-0a74f9fc4548]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f45a6-c7a5-420d-9762-ecdb1468e334]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:09:39 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10184a3-540d-407f-a588-7f9e883063f9]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d556f-e004-47fa-b98a-312b6db05ce3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c517f6b6-54ab-42a4-897a-9e916aedcd1b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260]
Aug 16 17:09:40 user nova-compute[73450]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a, portal: 172.16.0.220,3260] successful.
Aug 16 17:09:40 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981130f7-d56f-46f8-81dc-27dd5768c38a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7b1648-aa65-4621-8258-740c5126ee7e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== disconnect_volume: return (305ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:09:40 user nova-compute[73450]: DEBUG nova.objects.instance [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:09:41 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-d72f368b-af87-44aa-853f-1c8925ac7b18 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Port 5e09f50e-da33-40bf-bf8b-eb5e3c725c48 binding to destination host user is already ACTIVE {{(pid=73450) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Creating tmpfile /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/tmp19ip7wy1 to verify with other compute node that the instance is on the same shared storage. {{(pid=73450) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-96b6ab6e-51ca-40a8-be49-562b7b2e3823 req-cb414fe2-eb14-47c1-9315-5420105ded47 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-96b6ab6e-51ca-40a8-be49-562b7b2e3823 req-cb414fe2-eb14-47c1-9315-5420105ded47 service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-96b6ab6e-51ca-40a8-be49-562b7b2e3823 req-cb414fe2-eb14-47c1-9315-5420105ded47 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-96b6ab6e-51ca-40a8-be49-562b7b2e3823 req-cb414fe2-eb14-47c1-9315-5420105ded47 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-96b6ab6e-51ca-40a8-be49-562b7b2e3823 req-cb414fe2-eb14-47c1-9315-5420105ded47 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:09:52 user nova-compute[73450]: WARNING nova.compute.manager [req-96b6ab6e-51ca-40a8-be49-562b7b2e3823 req-cb414fe2-eb14-47c1-9315-5420105ded47 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state resized and task_state resize_reverting.
Aug 16 17:09:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:53 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance destroyed successfully.
Aug 16 17:09:53 user nova-compute[73450]: DEBUG nova.objects.instance [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'resources' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e09f50e-da, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:09:53 user nova-compute[73450]: INFO os_vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da')
Aug 16 17:09:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:09:53 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12181a31-6798-43c9-944e-2b89bcd5101e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe20afc-468f-4e2a-9c5b-81b70bfc6ac7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:09:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270195b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f45d1-72bf-4192-aa27-ae11ab44328a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7744bac3-5527-4a31-8a74-320181fe6a6c]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea2487f-d81e-4073-a08f-6e739ac02df7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe7eb8-7657-4ecd-a20a-7c8deb233d5f]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d13bbe-8e9d-4725-a339-3a2a496c9039]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04fcfab-ffa6-4f6d-9df2-07a0b857289c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]
Aug 16 17:09:53 user nova-compute[73450]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.
Aug 16 17:09:53 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e84ae0-2f3a-4cc6-8f1a-862f088d6a33]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== disconnect_volume: return (283ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:09:53 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:09:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:54 user nova-compute[73450]: DEBUG nova.objects.instance [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'migration_context' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:09:54 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:09:54 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:09:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.275s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-78a9aa51-83a7-4b43-ac33-20e477b84f27 req-e8bb3ce1-c1cc-4c0a-8d13-0e876d152966 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-78a9aa51-83a7-4b43-ac33-20e477b84f27 req-e8bb3ce1-c1cc-4c0a-8d13-0e876d152966 service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-78a9aa51-83a7-4b43-ac33-20e477b84f27 req-e8bb3ce1-c1cc-4c0a-8d13-0e876d152966 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-78a9aa51-83a7-4b43-ac33-20e477b84f27 req-e8bb3ce1-c1cc-4c0a-8d13-0e876d152966 service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-78a9aa51-83a7-4b43-ac33-20e477b84f27 req-e8bb3ce1-c1cc-4c0a-8d13-0e876d152966 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:09:55 user nova-compute[73450]: WARNING nova.compute.manager [req-78a9aa51-83a7-4b43-ac33-20e477b84f27 req-e8bb3ce1-c1cc-4c0a-8d13-0e876d152966 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state resized and task_state resize_reverting.
Aug 16 17:09:55 user nova-compute[73450]: INFO nova.compute.manager [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Swapping old allocation on dict_keys(['3f5625a5-ed70-4d17-8b42-ff2951fa276d']) held by migration 5204e870-8aa9-4a34-9900-9e7b6b82f76e for instance
Aug 16 17:09:55 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Overwriting current allocation {'allocations': {'3f5625a5-ed70-4d17-8b42-ff2951fa276d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 57}}, 'project_id': '79240e658cc64592aba46bb80975c127', 'user_id': '4a86e84a3c404ab6af0794f17a8d4ef3', 'consumer_generation': 1} on consumer e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG nova.network.neutron [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG os_brick.utils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20111e8-255c-491f-a754-8f5b81720693]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ffdf00-403f-4aed-bbb9-7551f8f56307]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db0d325-bba4-4d7e-b24f-a6f0a7a7138a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d99ca-6dc3-4c45-940c-6a893e4136ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:09:55 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:09:55 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd2d33-bc8f-4e9f-9032-f21be79c9775]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:09:55 user nova-compute[73450]: DEBUG os_brick.utils [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:09:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:09:59 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Starting finish_revert_migration {{(pid=73450) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start _get_guest_xml network_info=[{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'bcee75f7-8236-47c1-96fb-20374fae3741', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e28e8532-9094-44ba-9069-d7af964ba11a', 'attached_at': '2023-08-16T17:10:06.000000', 'detached_at': '', 'volume_id': '9320937a-d98f-4246-bab8-f2ccb0d00b28', 'serial': '9320937a-d98f-4246-bab8-f2ccb0d00b28'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:10:05 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:10:05 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.objects.instance [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'vcpu_model' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:10:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:10:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:10:05 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e68de-d515-4b37-8338-0103314ddc78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:10:05 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e219691-5eb6-473d-a408-9a9bb665785c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28] added
Aug 16 17:10:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e54b9c-d23d-49ba-bad0-959576c8ad2f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fb3245-d86e-4180-92e9-9d6f65675776]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnHpfYIU {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnHpfYIU" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c326437-26e0-4cf3-9562-79f49243b9b2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnHpfYIU'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa4f3f-f059-4b12-bfc7-fcbd918c57ad]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c61ba3-c07b-4c66-b7de-4b0519f0e6e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:10:05 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:10:05 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:10:05 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:10:05 user nova-compute[73450]: 
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbdb1db-a46c-4cca-be20-0658bf2aa81b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]
Aug 16 17:10:05 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.
Aug 16 17:10:05 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:05 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[061397b9-03ba-4265-9f1f-bad5a8608e8e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58371ef-a30f-4136-b879-431a450bfaab]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:06 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[641e2704-4c1e-4369-91de-05a33836ec10]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-changed-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.compute.manager [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Refreshing instance network info cache due to event network-changed-d1226183-cdc9-4b1b-b05d-9e47e2b69a52. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] Acquiring lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] Acquired lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.network.neutron [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Refreshing network info cache for port d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:06 user nova-compute[73450]: DEBUG nova.objects.instance [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'flavor' on Instance uuid 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:06 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Ignoring supplied device name: /dev/vdb
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26430613032626135', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430613032626135', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:10:07 user nova-compute[73450]:   <uuid>e28e8532-9094-44ba-9069-d7af964ba11a</uuid>
Aug 16 17:10:07 user nova-compute[73450]:   <name>instance-0000002d</name>
Aug 16 17:10:07 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:10:07 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:10:07 user nova-compute[73450]:   <metadata>
Aug 16 17:10:07 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:10:07 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:10:07 user nova-compute[73450]:       <nova:name>tempest-ServerActionsTestOtherB-server-877252721</nova:name>
Aug 16 17:10:07 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:10:05</nova:creationTime>
Aug 16 17:10:07 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:10:07 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:10:07 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:10:07 user nova-compute[73450]:       <nova:owner>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:user uuid="4a86e84a3c404ab6af0794f17a8d4ef3">tempest-ServerActionsTestOtherB-616819457-project-member</nova:user>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:project uuid="79240e658cc64592aba46bb80975c127">tempest-ServerActionsTestOtherB-616819457</nova:project>
Aug 16 17:10:07 user nova-compute[73450]:       </nova:owner>
Aug 16 17:10:07 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:10:07 user nova-compute[73450]:       <nova:ports>
Aug 16 17:10:07 user nova-compute[73450]:         <nova:port uuid="5e09f50e-da33-40bf-bf8b-eb5e3c725c48">
Aug 16 17:10:07 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 17:10:07 user nova-compute[73450]:         </nova:port>
Aug 16 17:10:07 user nova-compute[73450]:       </nova:ports>
Aug 16 17:10:07 user nova-compute[73450]:     </nova:instance>
Aug 16 17:10:07 user nova-compute[73450]:   </metadata>
Aug 16 17:10:07 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:10:07 user nova-compute[73450]:     <system>
Aug 16 17:10:07 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:10:07 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:10:07 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:10:07 user nova-compute[73450]:       <entry name="serial">e28e8532-9094-44ba-9069-d7af964ba11a</entry>
Aug 16 17:10:07 user nova-compute[73450]:       <entry name="uuid">e28e8532-9094-44ba-9069-d7af964ba11a</entry>
Aug 16 17:10:07 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:10:07 user nova-compute[73450]:     </system>
Aug 16 17:10:07 user nova-compute[73450]:   </sysinfo>
Aug 16 17:10:07 user nova-compute[73450]:   <os>
Aug 16 17:10:07 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:10:07 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:10:07 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:10:07 user nova-compute[73450]:   </os>
Aug 16 17:10:07 user nova-compute[73450]:   <features>
Aug 16 17:10:07 user nova-compute[73450]:     <acpi/>
Aug 16 17:10:07 user nova-compute[73450]:     <apic/>
Aug 16 17:10:07 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:10:07 user nova-compute[73450]:   </features>
Aug 16 17:10:07 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:10:07 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:10:07 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:10:07 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:10:07 user nova-compute[73450]:   </clock>
Aug 16 17:10:07 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:10:07 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:10:07 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:10:07 user nova-compute[73450]:   </cpu>
Aug 16 17:10:07 user nova-compute[73450]:   <devices>
Aug 16 17:10:07 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:10:07 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:10:07 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk"/>
Aug 16 17:10:07 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:10:07 user nova-compute[73450]:     </disk>
Aug 16 17:10:07 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 17:10:07 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:10:07 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 17:10:07 user nova-compute[73450]:       <target dev="vdb" bus="virtio"/>
Aug 16 17:10:07 user nova-compute[73450]:       <serial>9320937a-d98f-4246-bab8-f2ccb0d00b28</serial>
Aug 16 17:10:07 user nova-compute[73450]:     </disk>
Aug 16 17:10:07 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:10:07 user nova-compute[73450]:       <mac address="fa:16:3e:8b:89:8b"/>
Aug 16 17:10:07 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:10:07 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:10:07 user nova-compute[73450]:       <target dev="tap5e09f50e-da"/>
Aug 16 17:10:07 user nova-compute[73450]:     </interface>
Aug 16 17:10:07 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:10:07 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/console.log" append="off"/>
Aug 16 17:10:07 user nova-compute[73450]:     </serial>
Aug 16 17:10:07 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:10:07 user nova-compute[73450]:     <video>
Aug 16 17:10:07 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:10:07 user nova-compute[73450]:     </video>
Aug 16 17:10:07 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:10:07 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:10:07 user nova-compute[73450]:     </rng>
Aug 16 17:10:07 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:10:07 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:10:07 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:10:07 user nova-compute[73450]:     </memballoon>
Aug 16 17:10:07 user nova-compute[73450]:   </devices>
Aug 16 17:10:07 user nova-compute[73450]: </domain>
Aug 16 17:10:07 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e09f50e-da, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e09f50e-da, col_values=(('external_ids', {'iface-id': '5e09f50e-da33-40bf-bf8b-eb5e3c725c48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:89:8b', 'vm-uuid': 'e28e8532-9094-44ba-9069-d7af964ba11a'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:07 user nova-compute[73450]: INFO os_vif [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da')
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updated VIF entry in instance network info cache for port d1226183-cdc9-4b1b-b05d-9e47e2b69a52. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.network.neutron [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updating instance_info_cache with network_info: [{"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:07 user nova-compute[73450]: INFO nova.compute.manager [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Attaching volume 8818c64f-40c3-41cf-be62-74a934834010 to /dev/vdb
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4ecca5e3-c9ea-49fb-a5de-07bb499ea49c req-245c4d80-3ca3-4e44-9534-4ba90221615d service nova] Releasing lock "refresh_cache-5c27eb33-5d49-41f4-8485-c9f21537bb5a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.utils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7267f83-09c6-4372-b8a1-35a162f2578d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2d2410-ec9c-4b43-94c5-dba42d570cab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a9402-2dd6-435d-87f0-b0867ecb3424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1b145-e3e2-4ccf-b0bb-2ebe6795c5e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:10:07 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:10:07 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a855924-af44-4bd9-81ea-53147d3d911b]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG os_brick.utils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:10:07 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updating existing volume attachment record: a095705f-61c4-4d2a-8203-9cfb093d0891 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205793.4820416, e28e8532-9094-44ba-9069-d7af964ba11a => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:10:08 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Stopped (Lifecycle Event)
Aug 16 17:10:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a363538e-e6f8-4158-ab1d-21f2d2abf2f3 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG nova.compute.manager [req-0b83dc00-1b53-43bf-aead-81951c70e9aa req-d55342a6-4c37-4710-958d-7a1e984b2d8c service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b83dc00-1b53-43bf-aead-81951c70e9aa req-d55342a6-4c37-4710-958d-7a1e984b2d8c service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b83dc00-1b53-43bf-aead-81951c70e9aa req-d55342a6-4c37-4710-958d-7a1e984b2d8c service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-0b83dc00-1b53-43bf-aead-81951c70e9aa req-d55342a6-4c37-4710-958d-7a1e984b2d8c service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:08 user nova-compute[73450]: DEBUG nova.compute.manager [req-0b83dc00-1b53-43bf-aead-81951c70e9aa req-d55342a6-4c37-4710-958d-7a1e984b2d8c service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:10:08 user nova-compute[73450]: WARNING nova.compute.manager [req-0b83dc00-1b53-43bf-aead-81951c70e9aa req-d55342a6-4c37-4710-958d-7a1e984b2d8c service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state resized and task_state resize_reverting.
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205810.7205656, e28e8532-9094-44ba-9069-d7af964ba11a => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:10:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Resumed (Lifecycle Event)
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:10:10 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:10:10 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=23.863910675048828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:10 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance running successfully.
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] finish_revert_migration finished successfully. {{(pid=73450) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-68e36549-465c-4306-8b2b-77c03d22f456 req-10fad56c-4a9b-485b-b13b-1d066f969ffa service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68e36549-465c-4306-8b2b-77c03d22f456 req-10fad56c-4a9b-485b-b13b-1d066f969ffa service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68e36549-465c-4306-8b2b-77c03d22f456 req-10fad56c-4a9b-485b-b13b-1d066f969ffa service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68e36549-465c-4306-8b2b-77c03d22f456 req-10fad56c-4a9b-485b-b13b-1d066f969ffa service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [req-68e36549-465c-4306-8b2b-77c03d22f456 req-10fad56c-4a9b-485b-b13b-1d066f969ffa service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:10:10 user nova-compute[73450]: WARNING nova.compute.manager [req-68e36549-465c-4306-8b2b-77c03d22f456 req-10fad56c-4a9b-485b-b13b-1d066f969ffa service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state resized and task_state resize_reverting.
Aug 16 17:10:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205810.7222612, e28e8532-9094-44ba-9069-d7af964ba11a => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:10:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Started (Lifecycle Event)
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:10:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:10:10 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 17:10:11 user nova-compute[73450]: INFO nova.compute.manager [None req-de021c9f-17cb-42e2-b08f-e169ae54069d tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance to original state: 'active'
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:10:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:10:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzyCYvOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:10:18 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:10:18 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:10:18 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf65f35-a85a-486d-8317-535dd5aa48cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:10:18 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[87362524-937e-4c5c-9400-d3f491dfe9e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010] added
Aug 16 17:10:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a72642-3f9f-4860-93fa-72d283b9a12d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a4fbf9-f033-4194-9653-026f30bdeb38]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzyCYvOQ {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzyCYvOQ" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01302bb-a826-4534-b909-747df195e886]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SzyCYvOQ'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb96eec6-9659-4c61-bc74-b240f0c04fea]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce7cd31-49af-4058-9d15-91d36132cc4e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79768dc-056a-43e8-88b3-c10d48b026ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260]
Aug 16 17:10:18 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260] successful.
Aug 16 17:10:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde04609-ef8c-4a4e-b59b-f94dc3dc203f]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32fda18-4666-48d5-975a-0ea230eaf811]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:18 user nova-compute[73450]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 (non-flash)
Aug 16 17:10:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:18 user nova-compute[73450]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 (non-flash)
Aug 16 17:10:18 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[765438b8-a479-4451-88ea-75ae77e6b102]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:10:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzyCYvOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:10:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:10:19 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23037663133336135', 'path': '/dev/sdc'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:10:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037663133336135', 'path': '/dev/sdc'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:10:19 user nova-compute[73450]: DEBUG nova.objects.instance [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'flavor' on Instance uuid 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:10:19 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:10:19 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:10:19 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:10:19 user nova-compute[73450]:   <serial>8818c64f-40c3-41cf-be62-74a934834010</serial>
Aug 16 17:10:19 user nova-compute[73450]: </disk>
Aug 16 17:10:19 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:10:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:10:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:10:20 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] No VIF found with MAC fa:16:3e:bb:a2:08, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:10:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-560b181a-c373-4f17-8a75-e6c2d4d64995 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.032s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:10:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:10:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:10:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:10:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:26 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 17:10:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 17:10:27 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:10:27 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 17:10:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:29 user nova-compute[73450]: INFO nova.compute.manager [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Terminating instance
Aug 16 17:10:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-68e11c2c-8d9d-4e14-b8cf-db0e44fd5503 req-fe6c25a7-6977-478e-b16c-a8971027c745 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-vif-unplugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68e11c2c-8d9d-4e14-b8cf-db0e44fd5503 req-fe6c25a7-6977-478e-b16c-a8971027c745 service nova] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68e11c2c-8d9d-4e14-b8cf-db0e44fd5503 req-fe6c25a7-6977-478e-b16c-a8971027c745 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-68e11c2c-8d9d-4e14-b8cf-db0e44fd5503 req-fe6c25a7-6977-478e-b16c-a8971027c745 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-68e11c2c-8d9d-4e14-b8cf-db0e44fd5503 req-fe6c25a7-6977-478e-b16c-a8971027c745 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] No waiting events found dispatching network-vif-unplugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:10:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-68e11c2c-8d9d-4e14-b8cf-db0e44fd5503 req-fe6c25a7-6977-478e-b16c-a8971027c745 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-vif-unplugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Instance destroyed successfully.
Aug 16 17:10:30 user nova-compute[73450]: DEBUG nova.objects.instance [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'resources' on Instance uuid 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1657262987',display_name='tempest-AttachVolumeNegativeTest-server-1657262987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1657262987',id=47,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGtDRVs1zSgCYMJsd65u1Ihn/L6dkhgtf3yMr2ca2InuRFvw5BgFi1XOrn6uNZutRFFlHiy6zY0rAkeOs4flJdlQmz3idwQTYxec65AltqV9LX69FceXP7PSZ3ckdks9g==',key_name='tempest-keypair-1870909103',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-1hqt108m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=05f7254d-cd8d-431e-9b92-c2e4c1fe1a33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "address": "fa:16:3e:ce:ae:35", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b0aa62-e3", "ovs_interfaceid": "79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG os_vif [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79b0aa62-e3, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:10:30 user nova-compute[73450]: INFO os_vif [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b0aa62-e3')
Aug 16 17:10:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Deleting instance files /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33_del
Aug 16 17:10:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Deletion of /opt/stack/data/nova/instances/05f7254d-cd8d-431e-9b92-c2e4c1fe1a33_del complete
Aug 16 17:10:30 user nova-compute[73450]: INFO nova.compute.manager [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 17:10:30 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:10:30 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:10:31 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Took 1.08 seconds to deallocate network for instance.
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:31 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Deleted allocations for instance 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-05eb7d17-7e46-4de3-8b88-ebc4474e957f tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] Acquiring lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] Lock "05f7254d-cd8d-431e-9b92-c2e4c1fe1a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] No waiting events found dispatching network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:10:31 user nova-compute[73450]: WARNING nova.compute.manager [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received unexpected event network-vif-plugged-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 for instance with vm_state deleted and task_state None.
Aug 16 17:10:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-81bbd199-101f-49a8-b92c-15c533cee212 req-5551d6a1-8ae4-4244-9d18-f639e3ac7db5 service nova] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Received event network-vif-deleted-79b0aa62-e3ad-465f-bf7f-84c6ff3ed8d6 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205830.3563185, 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:10:45 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] VM Stopped (Lifecycle Event)
Aug 16 17:10:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-a28c26f7-bcb2-426e-9efe-30ed52d78bbe None None] [instance: 05f7254d-cd8d-431e-9b92-c2e4c1fe1a33] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:10:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:54 user nova-compute[73450]: INFO nova.compute.manager [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Detaching volume 8818c64f-40c3-41cf-be62-74a934834010
Aug 16 17:10:54 user nova-compute[73450]: INFO nova.virt.block_device [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Attempting to driver detach volume 8818c64f-40c3-41cf-be62-74a934834010 from mountpoint /dev/vdb
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Attempting to detach device vdb from instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:10:54 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:10:54 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:10:54 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:10:54 user nova-compute[73450]:   <serial>8818c64f-40c3-41cf-be62-74a934834010</serial>
Aug 16 17:10:54 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:10:54 user nova-compute[73450]: </disk>
Aug 16 17:10:54 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully detached device vdb from instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a from the persistent domain config.
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:10:54 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:10:54 user nova-compute[73450]:   <source dev="/dev/sdc"/>
Aug 16 17:10:54 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:10:54 user nova-compute[73450]:   <serial>8818c64f-40c3-41cf-be62-74a934834010</serial>
Aug 16 17:10:54 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:10:54 user nova-compute[73450]: </disk>
Aug 16 17:10:54 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692205854.5891697, 5c27eb33-5d49-41f4-8485-c9f21537bb5a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:10:54 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully detached device vdb from instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a from the live domain config.
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzyCYvOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:10:54 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b48db5-f7ab-4f7b-8f67-72ab98429e9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34833ba-b5ec-4198-a2dd-720d0a53398b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:54 user nova-compute[73450]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 (non-flash)
Aug 16 17:10:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:54 user nova-compute[73450]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 (non-flash)
Aug 16 17:10:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe25060bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010'): ({'sdc'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Removing single pathed devices sdc {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab88f9f-8795-491f-b6d8-baac6d32b0a4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbd532-755a-4bb8-9e1e-9d198096f130]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Flushing IO for device /dev/sdc {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d1675-e45d-4238-a518-2acd16699384]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4cc607-7d16-46d8-bc4e-884ca5f3f5b1]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] SCSI volumes sdc have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb272e0-2f30-435d-8dce-646f6d45f3dc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba36bd-c4da-4c31-8ab9-99b62dcf2f95]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260]
Aug 16 17:10:54 user nova-compute[73450]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010, portal: 172.16.0.220,3260] successful.
Aug 16 17:10:54 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c4ef9-efd2-45f7-9719-d2f8580c19d0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== disconnect_volume: return (264ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:10:54 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG nova.objects.instance [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'flavor' on Instance uuid 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-553497e3-6aa9-4145-a039-0f184dc08379 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.512s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:55 user nova-compute[73450]: INFO nova.compute.manager [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Terminating instance
Aug 16 17:10:55 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-741071c5-7251-49ec-b5f8-eea88c9f234f req-a0965af9-5f5f-4e7a-b61e-7f5049496797 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-vif-unplugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-741071c5-7251-49ec-b5f8-eea88c9f234f req-a0965af9-5f5f-4e7a-b61e-7f5049496797 service nova] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-741071c5-7251-49ec-b5f8-eea88c9f234f req-a0965af9-5f5f-4e7a-b61e-7f5049496797 service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-741071c5-7251-49ec-b5f8-eea88c9f234f req-a0965af9-5f5f-4e7a-b61e-7f5049496797 service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-741071c5-7251-49ec-b5f8-eea88c9f234f req-a0965af9-5f5f-4e7a-b61e-7f5049496797 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] No waiting events found dispatching network-vif-unplugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:10:55 user nova-compute[73450]: DEBUG nova.compute.manager [req-741071c5-7251-49ec-b5f8-eea88c9f234f req-a0965af9-5f5f-4e7a-b61e-7f5049496797 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-vif-unplugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Instance destroyed successfully.
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.objects.instance [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lazy-loading 'resources' on Instance uuid 5c27eb33-5d49-41f4-8485-c9f21537bb5a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1811508103',display_name='tempest-VolumesSnapshotTestJSON-instance-1811508103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1811508103',id=48,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbQif8X4rurVSVqsOMPhsTyYVH0InKp3Dz+jdF8FHac/ptan5fve56aWYGGhDAMnuemJIytzTvd/s8fGIVEerGy26I1bgxPjMxT3d0w8/8+dX8Hm77Ghuuv1ljiVFLsPg==',key_name='tempest-keypair-1592645125',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='436aa2ca57fd4043aaa97b006f85c3dd',ramdisk_id='',reservation_id='r-23d393wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1425912104',owner_user_name='tempest-VolumesSnapshotTestJSON-1425912104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b7113acfc8d4d5296c710263ce33f08',uuid=5c27eb33-5d49-41f4-8485-c9f21537bb5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converting VIF {"id": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "address": "fa:16:3e:bb:a2:08", "network": {"id": "d4047882-afe8-4f98-ba44-fea99bd3301e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1099433140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "436aa2ca57fd4043aaa97b006f85c3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1226183-cd", "ovs_interfaceid": "d1226183-cdc9-4b1b-b05d-9e47e2b69a52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_vif [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1226183-cd, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:10:56 user nova-compute[73450]: INFO os_vif [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=d1226183-cdc9-4b1b-b05d-9e47e2b69a52,network=Network(d4047882-afe8-4f98-ba44-fea99bd3301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1226183-cd')
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzyCYvOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:10:56 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8818c64f-40c3-41cf-be62-74a934834010', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03f0d8-ae77-497e-8af8-1ac711186067]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca13ce-9491-48e5-b338-9ac714bebac3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:56 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:10:56 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe280025cf0>, {}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Disconnecting from: [] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] <== disconnect_volume: return (46ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:10:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Deleting instance files /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a_del
Aug 16 17:10:56 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Deletion of /opt/stack/data/nova/instances/5c27eb33-5d49-41f4-8485-c9f21537bb5a_del complete
Aug 16 17:10:56 user nova-compute[73450]: INFO nova.compute.manager [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 17:10:56 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:10:56 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:10:57 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Took 0.81 seconds to deallocate network for instance.
Aug 16 17:10:57 user nova-compute[73450]: WARNING nova.volume.cinder [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Attachment a095705f-61c4-4d2a-8203-9cfb093d0891 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a095705f-61c4-4d2a-8203-9cfb093d0891. (HTTP 404) (Request-ID: req-a53554c2-cb5f-41be-bacd-9f2499fb2335)
Aug 16 17:10:57 user nova-compute[73450]: INFO nova.compute.manager [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:57 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Deleted allocations for instance 5c27eb33-5d49-41f4-8485-c9f21537bb5a
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-8ec0d55f-8ecf-4b2d-b9a3-58f8db8203c8 tempest-VolumesSnapshotTestJSON-1425912104 tempest-VolumesSnapshotTestJSON-1425912104-project-member] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] Acquiring lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] Lock "5c27eb33-5d49-41f4-8485-c9f21537bb5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:10:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] No waiting events found dispatching network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:10:57 user nova-compute[73450]: WARNING nova.compute.manager [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received unexpected event network-vif-plugged-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 for instance with vm_state deleted and task_state None.
Aug 16 17:10:57 user nova-compute[73450]: DEBUG nova.compute.manager [req-d5854c06-febb-4891-a0d4-7a568217e128 req-685fe35a-dfda-45da-9a4f-2dc3d5e1ee34 service nova] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Received event network-vif-deleted-d1226183-cdc9-4b1b-b05d-9e47e2b69a52 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:11:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:06 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:11:07 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:11:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:11:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:09 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:11:09 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:11:10 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=23.917724609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:11:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:11 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205856.4134874, 5c27eb33-5d49-41f4-8485-c9f21537bb5a => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:11:11 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] VM Stopped (Lifecycle Event)
Aug 16 17:11:11 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d425759a-8efa-47df-bc02-c0a1ebda6eec None None] [instance: 5c27eb33-5d49-41f4-8485-c9f21537bb5a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:11:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:14 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:11:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:11:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:11:23 user nova-compute[73450]: INFO nova.compute.claims [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Claim successful on node user
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.network.neutron [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:11:23 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:11:23 user nova-compute[73450]: DEBUG nova.policy [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e23eb33a56994696b7295fdfd0d04cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c0497e2014ad6a8b92a44097f4fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:11:24 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Creating image(s)
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "/opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.177s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk 1073741824" returned: 0 in 0.053s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.182s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.network.neutron [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Successfully created port: 098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Cannot resize image /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.objects.instance [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'migration_context' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Ensure instance console log exists: /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Successfully updated port: 098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquired lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-changed-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.compute.manager [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Refreshing instance network info cache due to event network-changed-098efb5c-4d22-4abc-b8bc-3beb7dbf6252. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] Acquiring lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.neutron [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Releasing lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Instance network_info: |[{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] Acquired lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.neutron [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Refreshing network info cache for port 098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Start _get_guest_xml network_info=[{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:11:25 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:11:25 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1194774626',display_name='tempest-AttachVolumeNegativeTest-server-1194774626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1194774626',id=49,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeHDxqkKqB+pl1nifkFKXE02RlDDeJ8XbJyu+12q3H1QalMeaaDfiHdnw+tMJifcRg8/7hJtztxK7aKnRfiv6uVTAiSfO8cG/5m4IfoRrfzwiVhQRbgqov5s3cV+bhkLA==',key_name='tempest-keypair-2142054411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-qbm9sing',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=b7c78901-d528-42d4-b9db-efcd79218d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.objects.instance [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'pci_devices' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:11:25 user nova-compute[73450]:   <uuid>b7c78901-d528-42d4-b9db-efcd79218d5c</uuid>
Aug 16 17:11:25 user nova-compute[73450]:   <name>instance-00000031</name>
Aug 16 17:11:25 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:11:25 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:11:25 user nova-compute[73450]:   <metadata>
Aug 16 17:11:25 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:11:25 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:11:25 user nova-compute[73450]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1194774626</nova:name>
Aug 16 17:11:25 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:11:25</nova:creationTime>
Aug 16 17:11:25 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:11:25 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:11:25 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:11:25 user nova-compute[73450]:       <nova:owner>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:user uuid="e23eb33a56994696b7295fdfd0d04cac">tempest-AttachVolumeNegativeTest-1594829227-project-member</nova:user>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:project uuid="9b7c0497e2014ad6a8b92a44097f4fb7">tempest-AttachVolumeNegativeTest-1594829227</nova:project>
Aug 16 17:11:25 user nova-compute[73450]:       </nova:owner>
Aug 16 17:11:25 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:11:25 user nova-compute[73450]:       <nova:ports>
Aug 16 17:11:25 user nova-compute[73450]:         <nova:port uuid="098efb5c-4d22-4abc-b8bc-3beb7dbf6252">
Aug 16 17:11:25 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 17:11:25 user nova-compute[73450]:         </nova:port>
Aug 16 17:11:25 user nova-compute[73450]:       </nova:ports>
Aug 16 17:11:25 user nova-compute[73450]:     </nova:instance>
Aug 16 17:11:25 user nova-compute[73450]:   </metadata>
Aug 16 17:11:25 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:11:25 user nova-compute[73450]:     <system>
Aug 16 17:11:25 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:11:25 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:11:25 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:11:25 user nova-compute[73450]:       <entry name="serial">b7c78901-d528-42d4-b9db-efcd79218d5c</entry>
Aug 16 17:11:25 user nova-compute[73450]:       <entry name="uuid">b7c78901-d528-42d4-b9db-efcd79218d5c</entry>
Aug 16 17:11:25 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:11:25 user nova-compute[73450]:     </system>
Aug 16 17:11:25 user nova-compute[73450]:   </sysinfo>
Aug 16 17:11:25 user nova-compute[73450]:   <os>
Aug 16 17:11:25 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:11:25 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:11:25 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:11:25 user nova-compute[73450]:   </os>
Aug 16 17:11:25 user nova-compute[73450]:   <features>
Aug 16 17:11:25 user nova-compute[73450]:     <acpi/>
Aug 16 17:11:25 user nova-compute[73450]:     <apic/>
Aug 16 17:11:25 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:11:25 user nova-compute[73450]:   </features>
Aug 16 17:11:25 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:11:25 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:11:25 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:11:25 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:11:25 user nova-compute[73450]:   </clock>
Aug 16 17:11:25 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:11:25 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:11:25 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:11:25 user nova-compute[73450]:   </cpu>
Aug 16 17:11:25 user nova-compute[73450]:   <devices>
Aug 16 17:11:25 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:11:25 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:11:25 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk"/>
Aug 16 17:11:25 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:11:25 user nova-compute[73450]:     </disk>
Aug 16 17:11:25 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:11:25 user nova-compute[73450]:       <mac address="fa:16:3e:92:87:5a"/>
Aug 16 17:11:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:11:25 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:11:25 user nova-compute[73450]:       <target dev="tap098efb5c-4d"/>
Aug 16 17:11:25 user nova-compute[73450]:     </interface>
Aug 16 17:11:25 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:11:25 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/console.log" append="off"/>
Aug 16 17:11:25 user nova-compute[73450]:     </serial>
Aug 16 17:11:25 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:11:25 user nova-compute[73450]:     <video>
Aug 16 17:11:25 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:11:25 user nova-compute[73450]:     </video>
Aug 16 17:11:25 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:11:25 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:11:25 user nova-compute[73450]:     </rng>
Aug 16 17:11:25 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:11:25 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:11:25 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:11:25 user nova-compute[73450]:     </memballoon>
Aug 16 17:11:25 user nova-compute[73450]:   </devices>
Aug 16 17:11:25 user nova-compute[73450]: </domain>
Aug 16 17:11:25 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1194774626',display_name='tempest-AttachVolumeNegativeTest-server-1194774626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1194774626',id=49,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeHDxqkKqB+pl1nifkFKXE02RlDDeJ8XbJyu+12q3H1QalMeaaDfiHdnw+tMJifcRg8/7hJtztxK7aKnRfiv6uVTAiSfO8cG/5m4IfoRrfzwiVhQRbgqov5s3cV+bhkLA==',key_name='tempest-keypair-2142054411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-qbm9sing',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=b7c78901-d528-42d4-b9db-efcd79218d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG os_vif [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap098efb5c-4d, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap098efb5c-4d, col_values=(('external_ids', {'iface-id': '098efb5c-4d22-4abc-b8bc-3beb7dbf6252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:87:5a', 'vm-uuid': 'b7c78901-d528-42d4-b9db-efcd79218d5c'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:25 user nova-compute[73450]: INFO os_vif [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d')
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:11:25 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:92:87:5a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:11:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updated VIF entry in instance network info cache for port 098efb5c-4d22-4abc-b8bc-3beb7dbf6252. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:11:26 user nova-compute[73450]: DEBUG nova.network.neutron [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:11:26 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4dec1c04-c454-4210-9b9c-13e05284ba30 req-6407cfab-d6ec-450c-b0ae-d8b319262dae service nova] Releasing lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-f6c38325-82d9-41db-be92-cba4ba8c16e0 req-e29c79f5-2087-4179-bcff-f2b5e4db45a5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f6c38325-82d9-41db-be92-cba4ba8c16e0 req-e29c79f5-2087-4179-bcff-f2b5e4db45a5 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f6c38325-82d9-41db-be92-cba4ba8c16e0 req-e29c79f5-2087-4179-bcff-f2b5e4db45a5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f6c38325-82d9-41db-be92-cba4ba8c16e0 req-e29c79f5-2087-4179-bcff-f2b5e4db45a5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG nova.compute.manager [req-f6c38325-82d9-41db-be92-cba4ba8c16e0 req-e29c79f5-2087-4179-bcff-f2b5e4db45a5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:11:27 user nova-compute[73450]: WARNING nova.compute.manager [req-f6c38325-82d9-41db-be92-cba4ba8c16e0 req-e29c79f5-2087-4179-bcff-f2b5e4db45a5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state building and task_state spawning.
Aug 16 17:11:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205889.3018334, b7c78901-d528-42d4-b9db-efcd79218d5c => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] VM Resumed (Lifecycle Event)
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Instance spawned successfully.
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692205889.3038185, b7c78901-d528-42d4-b9db-efcd79218d5c => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] VM Started (Lifecycle Event)
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-f5434c0a-331d-4a65-8259-8578c6959ee8 req-180c9c0c-ebc8-48a3-b374-9ff07c1c31b4 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f5434c0a-331d-4a65-8259-8578c6959ee8 req-180c9c0c-ebc8-48a3-b374-9ff07c1c31b4 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f5434c0a-331d-4a65-8259-8578c6959ee8 req-180c9c0c-ebc8-48a3-b374-9ff07c1c31b4 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f5434c0a-331d-4a65-8259-8578c6959ee8 req-180c9c0c-ebc8-48a3-b374-9ff07c1c31b4 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-f5434c0a-331d-4a65-8259-8578c6959ee8 req-180c9c0c-ebc8-48a3-b374-9ff07c1c31b4 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:11:29 user nova-compute[73450]: WARNING nova.compute.manager [req-f5434c0a-331d-4a65-8259-8578c6959ee8 req-180c9c0c-ebc8-48a3-b374-9ff07c1c31b4 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state building and task_state spawning.
Aug 16 17:11:29 user nova-compute[73450]: INFO nova.compute.manager [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Took 6.06 seconds to build instance.
Aug 16 17:11:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-07980699-7c78-4249-83b2-6cc29859db48 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.153s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:11:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:11:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:08 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [{"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-e28e8532-9094-44ba-9069-d7af964ba11a" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:12:09 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:12:11 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=23.8873291015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance e28e8532-9094-44ba-9069-d7af964ba11a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b7c78901-d528-42d4-b9db-efcd79218d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:12:11 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:14 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:14 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:12:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:12:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:12:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:12:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:12:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:12:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:12:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:12:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:43 user nova-compute[73450]: INFO nova.compute.manager [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Terminating instance
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-239adde8-be3b-4a5d-8079-a71e61523f29 req-73ff0e3d-7f8a-4d4c-9632-b2862d0771cf service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-239adde8-be3b-4a5d-8079-a71e61523f29 req-73ff0e3d-7f8a-4d4c-9632-b2862d0771cf service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-239adde8-be3b-4a5d-8079-a71e61523f29 req-73ff0e3d-7f8a-4d4c-9632-b2862d0771cf service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-239adde8-be3b-4a5d-8079-a71e61523f29 req-73ff0e3d-7f8a-4d4c-9632-b2862d0771cf service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-239adde8-be3b-4a5d-8079-a71e61523f29 req-73ff0e3d-7f8a-4d4c-9632-b2862d0771cf service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.compute.manager [req-239adde8-be3b-4a5d-8079-a71e61523f29 req-73ff0e3d-7f8a-4d4c-9632-b2862d0771cf service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-unplugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:12:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Instance destroyed successfully.
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.objects.instance [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lazy-loading 'resources' on Instance uuid e28e8532-9094-44ba-9069-d7af964ba11a {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-877252721',display_name='tempest-ServerActionsTestOtherB-server-877252721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-877252721',id=45,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5ZEOx03eFT0E8cRGbKf/sv7Xon5nLddXTy38++KlYhOlc4ths068XCFRvlSitpBt7+c38WttwVbzx/Nmdg7tHOq5jsj05G9NLDnrIurLG+yMZqEygaDt/PtFwZYt1sg==',key_name='tempest-keypair-941613922',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:10:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79240e658cc64592aba46bb80975c127',ramdisk_id='',reservation_id='r-j4v0ucd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-616819457',owner_user_name='tempest-ServerActionsTestOtherB-616819457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a86e84a3c404ab6af0794f17a8d4ef3',uuid=e28e8532-9094-44ba-9069-d7af964ba11a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converting VIF {"id": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "address": "fa:16:3e:8b:89:8b", "network": {"id": "121eede8-8ba8-4c24-86e2-3fcbb9d35014", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-150721346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79240e658cc64592aba46bb80975c127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e09f50e-da", "ovs_interfaceid": "5e09f50e-da33-40bf-bf8b-eb5e3c725c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_vif [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e09f50e-da, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:43 user nova-compute[73450]: INFO os_vif [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:89:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e09f50e-da33-40bf-bf8b-eb5e3c725c48,network=Network(121eede8-8ba8-4c24-86e2-3fcbb9d35014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e09f50e-da')
Aug 16 17:12:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnHpfYIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:12:43 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97d329-c3b2-429f-84cc-d0c917f1dff9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f76424-74b7-4751-87af-5e2ec0533b28]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:12:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 (non-flash)
Aug 16 17:12:43 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2707f5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef8f9e-07e9-4eb5-8515-f22cff077df6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5022ae6b-0dce-4e0e-a326-4e83f5380ce2]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a8985-d39f-4e54-b3ac-153da23a273d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:43 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37143e6-58c7-44d8-9800-2b00c0a20bf7]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e445c8-2b56-41fe-bf05-f1037172395d]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3f2493-ba45-4bc7-af22-08fe734abd87]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260]
Aug 16 17:12:44 user nova-compute[73450]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28, portal: 172.16.0.220,3260] successful.
Aug 16 17:12:44 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9320937a-d98f-4246-bab8-f2ccb0d00b28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37074390-04cb-4958-8371-a1251a7f0288]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] <== disconnect_volume: return (273ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:12:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Deleting instance files /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a_del
Aug 16 17:12:44 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Deletion of /opt/stack/data/nova/instances/e28e8532-9094-44ba-9069-d7af964ba11a_del complete
Aug 16 17:12:44 user nova-compute[73450]: INFO nova.compute.manager [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 17:12:44 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:12:44 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:12:45 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Took 0.90 seconds to deallocate network for instance.
Aug 16 17:12:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-1f312da8-b859-4802-88a1-ebc7a401c87f req-66df3b3d-8815-4d63-b4a7-0601d5e01787 service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-deleted-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-ebb287d3-96ac-4b79-a7ac-0bc459269d15 req-0e16292b-d8ad-409f-b4c1-f544ccf4bdbb service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ebb287d3-96ac-4b79-a7ac-0bc459269d15 req-0e16292b-d8ad-409f-b4c1-f544ccf4bdbb service nova] Acquiring lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ebb287d3-96ac-4b79-a7ac-0bc459269d15 req-0e16292b-d8ad-409f-b4c1-f544ccf4bdbb service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-ebb287d3-96ac-4b79-a7ac-0bc459269d15 req-0e16292b-d8ad-409f-b4c1-f544ccf4bdbb service nova] Lock "e28e8532-9094-44ba-9069-d7af964ba11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-ebb287d3-96ac-4b79-a7ac-0bc459269d15 req-0e16292b-d8ad-409f-b4c1-f544ccf4bdbb service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] No waiting events found dispatching network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:12:45 user nova-compute[73450]: WARNING nova.compute.manager [req-ebb287d3-96ac-4b79-a7ac-0bc459269d15 req-0e16292b-d8ad-409f-b4c1-f544ccf4bdbb service nova] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Received unexpected event network-vif-plugged-5e09f50e-da33-40bf-bf8b-eb5e3c725c48 for instance with vm_state active and task_state deleting.
Aug 16 17:12:45 user nova-compute[73450]: INFO nova.compute.manager [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Took 0.80 seconds to detach 1 volumes for instance.
Aug 16 17:12:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:12:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:12:46 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:12:46 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:12:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:46 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Deleted allocations for instance e28e8532-9094-44ba-9069-d7af964ba11a
Aug 16 17:12:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-6eca41e2-b26b-42cc-82db-12df8390a838 tempest-ServerActionsTestOtherB-616819457 tempest-ServerActionsTestOtherB-616819457-project-member] Lock "e28e8532-9094-44ba-9069-d7af964ba11a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:12:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:12:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:12:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:12:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:12:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:12:58 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692205963.8350022, e28e8532-9094-44ba-9069-d7af964ba11a => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:12:58 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] VM Stopped (Lifecycle Event)
Aug 16 17:12:58 user nova-compute[73450]: DEBUG nova.compute.manager [None req-d9b6dd09-8645-4e86-bd0b-4fd34128badb None None] [instance: e28e8532-9094-44ba-9069-d7af964ba11a] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:12:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:13:09 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:13:10 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:13:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:12 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:13:12 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:13:12 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=23.913665771484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:13:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b7c78901-d528-42d4-b9db-efcd79218d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:13:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-changed-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:13:14 user nova-compute[73450]: DEBUG nova.compute.manager [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Refreshing instance network info cache due to event network-changed-098efb5c-4d22-4abc-b8bc-3beb7dbf6252. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:13:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] Acquiring lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:13:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] Acquired lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:13:14 user nova-compute[73450]: DEBUG nova.network.neutron [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Refreshing network info cache for port 098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG nova.network.neutron [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updated VIF entry in instance network info cache for port 098efb5c-4d22-4abc-b8bc-3beb7dbf6252. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG nova.network.neutron [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-cc98307c-d83e-436a-a587-dcbee1333ecd req-6be53b27-da83-4c26-9f9e-7ca83bb0654f service nova] Releasing lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG nova.objects.instance [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:13:18 user nova-compute[73450]: INFO nova.compute.manager [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Attaching volume 2f87f9d2-158f-438e-9773-80f76a91408d to /dev/vdb
Aug 16 17:13:18 user nova-compute[73450]: DEBUG os_brick.utils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc57488-2d19-4795-a96e-ca60eb88af0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[40840869-0dc0-43b8-95fa-ef0b25af24b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3af986-7686-4a4e-a344-20d0068a3fc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b5606-dd27-4011-9bc2-3bee347da414]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:13:18 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:13:18 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af2c561-d2dc-4858-a259-d78da5bfc4cf]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG os_brick.utils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:13:18 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating existing volume attachment record: 667daeff-923a-4cfa-a135-001037419394 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:13:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:13:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDSJEXjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:13:28 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:13:28 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:13:28 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeaa99d-8b92-4d15-b10a-73d761865527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:13:28 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04dc7c-05b8-4e7c-84eb-099d26062a9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d] added
Aug 16 17:13:28 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680b9a0-6702-4ce4-92c0-11e98d5185fc]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df8e1b7-28f7-48fc-85a8-772a4579d527]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDSJEXjV {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDSJEXjV" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ed314a-c73e-45bf-8663-e1de0581cc95]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDSJEXjV'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b586d6-c904-4677-889a-98f4e7505fe3]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e8076-4886-4f83-b62d-145478d9ad14]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:13:28 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:13:28 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:13:28 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:13:28 user nova-compute[73450]: 
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e162c2d-10bd-4411-bfa6-1d08cb8fd761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260]
Aug 16 17:13:28 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260] successful.
Aug 16 17:13:28 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[923d0111-db03-47ee-ba51-02b150d308a5]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c54623-08da-4df7-87e0-161dc6dad975]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d (non-flash)
Aug 16 17:13:28 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d (non-flash)
Aug 16 17:13:28 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df0b63-539b-4430-8f69-8369418a9c6c]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:13:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDSJEXjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23662656631633339', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662656631633339', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG nova.objects.instance [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:13:29 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 17:13:29 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:13:29 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:13:29 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:13:29 user nova-compute[73450]:   <serial>2f87f9d2-158f-438e-9773-80f76a91408d</serial>
Aug 16 17:13:29 user nova-compute[73450]: </disk>
Aug 16 17:13:29 user nova-compute[73450]:  {{(pid=73450) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] No VIF found with MAC fa:16:3e:92:87:5a, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-602bb83a-c495-4bc3-a0ce-a17f41958337 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.629s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:13:30 user nova-compute[73450]: INFO nova.compute.manager [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Detaching volume 2f87f9d2-158f-438e-9773-80f76a91408d
Aug 16 17:13:30 user nova-compute[73450]: INFO nova.virt.block_device [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Attempting to driver detach volume 2f87f9d2-158f-438e-9773-80f76a91408d from mountpoint /dev/vdb
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Attempting to detach device vdb from instance b7c78901-d528-42d4-b9db-efcd79218d5c from the persistent domain config. {{(pid=73450) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:13:30 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:13:30 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:13:30 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:13:30 user nova-compute[73450]:   <serial>2f87f9d2-158f-438e-9773-80f76a91408d</serial>
Aug 16 17:13:30 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:13:30 user nova-compute[73450]: </disk>
Aug 16 17:13:30 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:13:30 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully detached device vdb from instance b7c78901-d528-42d4-b9db-efcd79218d5c from the persistent domain config.
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7c78901-d528-42d4-b9db-efcd79218d5c from the live domain config. {{(pid=73450) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 17:13:30 user nova-compute[73450]: DEBUG nova.virt.libvirt.guest [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 17:13:30 user nova-compute[73450]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:13:30 user nova-compute[73450]:   <source dev="/dev/sdb"/>
Aug 16 17:13:30 user nova-compute[73450]:   <target dev="vdb" bus="virtio"/>
Aug 16 17:13:30 user nova-compute[73450]:   <serial>2f87f9d2-158f-438e-9773-80f76a91408d</serial>
Aug 16 17:13:30 user nova-compute[73450]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 17:13:30 user nova-compute[73450]: </disk>
Aug 16 17:13:30 user nova-compute[73450]:  {{(pid=73450) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Received event <DeviceRemovedEvent: 1692206011.3038447, b7c78901-d528-42d4-b9db-efcd79218d5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73450) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 17:13:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully detached device vdb from instance b7c78901-d528-42d4-b9db-efcd79218d5c from the live domain config.
Aug 16 17:13:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDSJEXjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:13:31 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[735a66f5-776f-439f-b19d-432df0032d94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad048eb2-3230-4005-a102-0e9e30318c05]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d (non-flash)
Aug 16 17:13:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d (non-flash)
Aug 16 17:13:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe250790790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[129005fb-56cc-4357-9599-078f3191f74f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[100a6152-1611-4f6d-be89-39b771ff6bb6]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522c83e-b373-4ac2-ab52-a872a63b1cca]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a26ef-0261-4b48-9e80-dd2f5f197a89]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[363f0f97-6106-43ac-9af7-93e71fba0e22]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d54ea-bba1-4b32-b8e2-f478d4c8e1d6]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260]
Aug 16 17:13:31 user nova-compute[73450]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d, portal: 172.16.0.220,3260] successful.
Aug 16 17:13:31 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f87f9d2-158f-438e-9773-80f76a91408d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2519f9e8-0e58-4b9a-a478-4c68871145f8]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] <== disconnect_volume: return (253ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:13:31 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:13:32 user nova-compute[73450]: DEBUG nova.objects.instance [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'flavor' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:13:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-c60053a1-86b2-494f-9d93-96a309e6ea28 tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:13:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:43 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:48 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:13:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:14:01 user nova-compute[73450]: INFO nova.compute.claims [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Claim successful on node user
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.network.neutron [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:14:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.policy [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b35b154180604b04929cbdac03936e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ec562890145a68e233bc28d85ca9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:14:01 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Creating image(s)
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "/opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "/opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "/opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:01 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.199s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.173s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk 1073741824" returned: 0 in 0.054s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG nova.network.neutron [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Successfully created port: 68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.178s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Cannot resize image /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG nova.objects.instance [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lazy-loading 'migration_context' on Instance uuid 496a4c19-48b4-4617-be19-823c1f3c2a0b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Ensure instance console log exists: /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:02 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Successfully updated port: 68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquired lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-changed-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.compute.manager [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Refreshing instance network info cache due to event network-changed-68db2cf9-445e-44b7-9fa0-62b5bef13b6d. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] Acquiring lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Updating instance_info_cache with network_info: [{"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Releasing lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Instance network_info: |[{"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] Acquired lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Refreshing network info cache for port 68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Start _get_guest_xml network_info=[{"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:14:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:14:03 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1011886858',display_name='tempest-VolumesActionsTest-instance-1011886858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1011886858',id=50,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='059ec562890145a68e233bc28d85ca9f',ramdisk_id='',reservation_id='r-8bgb60lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-437822511',owner_user_name='tempest-VolumesActionsTest-437822511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:14:02Z,user_data=None,user_id='b35b154180604b04929cbdac03936e84',uuid=496a4c19-48b4-4617-be19-823c1f3c2a0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converting VIF {"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.objects.instance [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lazy-loading 'pci_devices' on Instance uuid 496a4c19-48b4-4617-be19-823c1f3c2a0b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:14:03 user nova-compute[73450]:   <uuid>496a4c19-48b4-4617-be19-823c1f3c2a0b</uuid>
Aug 16 17:14:03 user nova-compute[73450]:   <name>instance-00000032</name>
Aug 16 17:14:03 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:14:03 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:14:03 user nova-compute[73450]:   <metadata>
Aug 16 17:14:03 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:14:03 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:14:03 user nova-compute[73450]:       <nova:name>tempest-VolumesActionsTest-instance-1011886858</nova:name>
Aug 16 17:14:03 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:14:03</nova:creationTime>
Aug 16 17:14:03 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:14:03 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:14:03 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:14:03 user nova-compute[73450]:       <nova:owner>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:user uuid="b35b154180604b04929cbdac03936e84">tempest-VolumesActionsTest-437822511-project-member</nova:user>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:project uuid="059ec562890145a68e233bc28d85ca9f">tempest-VolumesActionsTest-437822511</nova:project>
Aug 16 17:14:03 user nova-compute[73450]:       </nova:owner>
Aug 16 17:14:03 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:14:03 user nova-compute[73450]:       <nova:ports>
Aug 16 17:14:03 user nova-compute[73450]:         <nova:port uuid="68db2cf9-445e-44b7-9fa0-62b5bef13b6d">
Aug 16 17:14:03 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 17:14:03 user nova-compute[73450]:         </nova:port>
Aug 16 17:14:03 user nova-compute[73450]:       </nova:ports>
Aug 16 17:14:03 user nova-compute[73450]:     </nova:instance>
Aug 16 17:14:03 user nova-compute[73450]:   </metadata>
Aug 16 17:14:03 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:14:03 user nova-compute[73450]:     <system>
Aug 16 17:14:03 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:14:03 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:14:03 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:14:03 user nova-compute[73450]:       <entry name="serial">496a4c19-48b4-4617-be19-823c1f3c2a0b</entry>
Aug 16 17:14:03 user nova-compute[73450]:       <entry name="uuid">496a4c19-48b4-4617-be19-823c1f3c2a0b</entry>
Aug 16 17:14:03 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:14:03 user nova-compute[73450]:     </system>
Aug 16 17:14:03 user nova-compute[73450]:   </sysinfo>
Aug 16 17:14:03 user nova-compute[73450]:   <os>
Aug 16 17:14:03 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:14:03 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:14:03 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:14:03 user nova-compute[73450]:   </os>
Aug 16 17:14:03 user nova-compute[73450]:   <features>
Aug 16 17:14:03 user nova-compute[73450]:     <acpi/>
Aug 16 17:14:03 user nova-compute[73450]:     <apic/>
Aug 16 17:14:03 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:14:03 user nova-compute[73450]:   </features>
Aug 16 17:14:03 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:14:03 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:14:03 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:14:03 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:14:03 user nova-compute[73450]:   </clock>
Aug 16 17:14:03 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:14:03 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:14:03 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:14:03 user nova-compute[73450]:   </cpu>
Aug 16 17:14:03 user nova-compute[73450]:   <devices>
Aug 16 17:14:03 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:14:03 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:14:03 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk"/>
Aug 16 17:14:03 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:14:03 user nova-compute[73450]:     </disk>
Aug 16 17:14:03 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:14:03 user nova-compute[73450]:       <mac address="fa:16:3e:78:c4:40"/>
Aug 16 17:14:03 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:14:03 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:14:03 user nova-compute[73450]:       <target dev="tap68db2cf9-44"/>
Aug 16 17:14:03 user nova-compute[73450]:     </interface>
Aug 16 17:14:03 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:14:03 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/console.log" append="off"/>
Aug 16 17:14:03 user nova-compute[73450]:     </serial>
Aug 16 17:14:03 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:14:03 user nova-compute[73450]:     <video>
Aug 16 17:14:03 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:14:03 user nova-compute[73450]:     </video>
Aug 16 17:14:03 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:14:03 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:14:03 user nova-compute[73450]:     </rng>
Aug 16 17:14:03 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:14:03 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:14:03 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:14:03 user nova-compute[73450]:     </memballoon>
Aug 16 17:14:03 user nova-compute[73450]:   </devices>
Aug 16 17:14:03 user nova-compute[73450]: </domain>
Aug 16 17:14:03 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1011886858',display_name='tempest-VolumesActionsTest-instance-1011886858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1011886858',id=50,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='059ec562890145a68e233bc28d85ca9f',ramdisk_id='',reservation_id='r-8bgb60lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-437822511',owner_user_name='tempest-VolumesActionsTest-437822511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:14:02Z,user_data=None,user_id='b35b154180604b04929cbdac03936e84',uuid=496a4c19-48b4-4617-be19-823c1f3c2a0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converting VIF {"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG os_vif [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68db2cf9-44, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68db2cf9-44, col_values=(('external_ids', {'iface-id': '68db2cf9-445e-44b7-9fa0-62b5bef13b6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:c4:40', 'vm-uuid': '496a4c19-48b4-4617-be19-823c1f3c2a0b'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:03 user nova-compute[73450]: INFO os_vif [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44')
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] No VIF found with MAC fa:16:3e:78:c4:40, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Updated VIF entry in instance network info cache for port 68db2cf9-445e-44b7-9fa0-62b5bef13b6d. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG nova.network.neutron [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Updating instance_info_cache with network_info: [{"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:14:03 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aad6746c-1ef7-407d-a0d9-3b258e23a983 req-671e36a2-09f5-4508-b9b9-27f3a36a3e5e service nova] Releasing lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:14:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-d1a766d6-9137-45e3-937a-bd8a93a69954 req-c3665d0d-826e-4e6f-979d-8cba422efef1 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d1a766d6-9137-45e3-937a-bd8a93a69954 req-c3665d0d-826e-4e6f-979d-8cba422efef1 service nova] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d1a766d6-9137-45e3-937a-bd8a93a69954 req-c3665d0d-826e-4e6f-979d-8cba422efef1 service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d1a766d6-9137-45e3-937a-bd8a93a69954 req-c3665d0d-826e-4e6f-979d-8cba422efef1 service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG nova.compute.manager [req-d1a766d6-9137-45e3-937a-bd8a93a69954 req-c3665d0d-826e-4e6f-979d-8cba422efef1 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] No waiting events found dispatching network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:05 user nova-compute[73450]: WARNING nova.compute.manager [req-d1a766d6-9137-45e3-937a-bd8a93a69954 req-c3665d0d-826e-4e6f-979d-8cba422efef1 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received unexpected event network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d for instance with vm_state building and task_state spawning.
Aug 16 17:14:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206047.0361931, 496a4c19-48b4-4617-be19-823c1f3c2a0b => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] VM Resumed (Lifecycle Event)
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Instance spawned successfully.
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206047.0377088, 496a4c19-48b4-4617-be19-823c1f3c2a0b => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] VM Started (Lifecycle Event)
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe150837-79da-40fa-88fc-fe64e19d161f req-f1827a0b-303a-4310-8b43-da833bf2af3d service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe150837-79da-40fa-88fc-fe64e19d161f req-f1827a0b-303a-4310-8b43-da833bf2af3d service nova] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe150837-79da-40fa-88fc-fe64e19d161f req-f1827a0b-303a-4310-8b43-da833bf2af3d service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-fe150837-79da-40fa-88fc-fe64e19d161f req-f1827a0b-303a-4310-8b43-da833bf2af3d service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:07 user nova-compute[73450]: DEBUG nova.compute.manager [req-fe150837-79da-40fa-88fc-fe64e19d161f req-f1827a0b-303a-4310-8b43-da833bf2af3d service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] No waiting events found dispatching network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:07 user nova-compute[73450]: WARNING nova.compute.manager [req-fe150837-79da-40fa-88fc-fe64e19d161f req-f1827a0b-303a-4310-8b43-da833bf2af3d service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received unexpected event network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d for instance with vm_state building and task_state spawning.
Aug 16 17:14:07 user nova-compute[73450]: INFO nova.compute.manager [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Took 5.81 seconds to build instance.
Aug 16 17:14:07 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-216c43a4-b248-4a5d-a1f8-7d4e71d4db7e tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.900s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:11 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [{"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-b7c78901-d528-42d4-b9db-efcd79218d5c" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:14:12 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:13 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:14 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:14:14 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=23.902359008789062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance b7c78901-d528-42d4-b9db-efcd79218d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 496a4c19-48b4-4617-be19-823c1f3c2a0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:14:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:14:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:21 user nova-compute[73450]: INFO nova.compute.manager [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Terminating instance
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-86193045-15f6-447a-955d-26485bb26c25 req-92b00d65-c006-4098-921a-2f23204e996c service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-unplugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-86193045-15f6-447a-955d-26485bb26c25 req-92b00d65-c006-4098-921a-2f23204e996c service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-86193045-15f6-447a-955d-26485bb26c25 req-92b00d65-c006-4098-921a-2f23204e996c service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-86193045-15f6-447a-955d-26485bb26c25 req-92b00d65-c006-4098-921a-2f23204e996c service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-86193045-15f6-447a-955d-26485bb26c25 req-92b00d65-c006-4098-921a-2f23204e996c service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-unplugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.compute.manager [req-86193045-15f6-447a-955d-26485bb26c25 req-92b00d65-c006-4098-921a-2f23204e996c service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-unplugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Instance destroyed successfully.
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.objects.instance [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lazy-loading 'resources' on Instance uuid b7c78901-d528-42d4-b9db-efcd79218d5c {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1194774626',display_name='tempest-AttachVolumeNegativeTest-server-1194774626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1194774626',id=49,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeHDxqkKqB+pl1nifkFKXE02RlDDeJ8XbJyu+12q3H1QalMeaaDfiHdnw+tMJifcRg8/7hJtztxK7aKnRfiv6uVTAiSfO8cG/5m4IfoRrfzwiVhQRbgqov5s3cV+bhkLA==',key_name='tempest-keypair-2142054411',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:11:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7c0497e2014ad6a8b92a44097f4fb7',ramdisk_id='',reservation_id='r-qbm9sing',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1594829227',owner_user_name='tempest-AttachVolumeNegativeTest-1594829227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:11:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e23eb33a56994696b7295fdfd0d04cac',uuid=b7c78901-d528-42d4-b9db-efcd79218d5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converting VIF {"id": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "address": "fa:16:3e:92:87:5a", "network": {"id": "0179a67f-1217-4236-98fc-0c4719ec801e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-278357354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7c0497e2014ad6a8b92a44097f4fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098efb5c-4d", "ovs_interfaceid": "098efb5c-4d22-4abc-b8bc-3beb7dbf6252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG os_vif [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap098efb5c-4d, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:14:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:14:21 user nova-compute[73450]: INFO os_vif [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252,network=Network(0179a67f-1217-4236-98fc-0c4719ec801e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098efb5c-4d')
Aug 16 17:14:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Deleting instance files /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c_del
Aug 16 17:14:21 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Deletion of /opt/stack/data/nova/instances/b7c78901-d528-42d4-b9db-efcd79218d5c_del complete
Aug 16 17:14:22 user nova-compute[73450]: INFO nova.compute.manager [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 17:14:22 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-5792feee-cb4a-4ad7-935a-15c6b7142755 req-5f18f343-db5b-42c4-aa56-302042a23712 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-deleted-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:23 user nova-compute[73450]: INFO nova.compute.manager [req-5792feee-cb4a-4ad7-935a-15c6b7142755 req-5f18f343-db5b-42c4-aa56-302042a23712 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Neutron deleted interface 098efb5c-4d22-4abc-b8bc-3beb7dbf6252; detaching it from the instance and deleting it from the info cache
Aug 16 17:14:23 user nova-compute[73450]: DEBUG nova.network.neutron [req-5792feee-cb4a-4ad7-935a-15c6b7142755 req-5f18f343-db5b-42c4-aa56-302042a23712 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:14:23 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Took 1.07 seconds to deallocate network for instance.
Aug 16 17:14:23 user nova-compute[73450]: DEBUG nova.compute.manager [req-5792feee-cb4a-4ad7-935a-15c6b7142755 req-5f18f343-db5b-42c4-aa56-302042a23712 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Detach interface failed, port_id=098efb5c-4d22-4abc-b8bc-3beb7dbf6252, reason: Instance b7c78901-d528-42d4-b9db-efcd79218d5c could not be found. {{(pid=73450) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:14:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:23 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Deleted allocations for instance b7c78901-d528-42d4-b9db-efcd79218d5c
Aug 16 17:14:23 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-cd3b0f7b-1ad5-4031-a57b-389eb2cc344e tempest-AttachVolumeNegativeTest-1594829227 tempest-AttachVolumeNegativeTest-1594829227-project-member] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:24 user nova-compute[73450]: WARNING nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state deleted and task_state None.
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:24 user nova-compute[73450]: WARNING nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state deleted and task_state None.
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:24 user nova-compute[73450]: WARNING nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state deleted and task_state None.
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-unplugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-unplugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:24 user nova-compute[73450]: WARNING nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-unplugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state deleted and task_state None.
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Acquiring lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] Lock "b7c78901-d528-42d4-b9db-efcd79218d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:24 user nova-compute[73450]: DEBUG nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] No waiting events found dispatching network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:14:24 user nova-compute[73450]: WARNING nova.compute.manager [req-6bc66e79-e5a1-4501-bc94-0a395f1c7e6e req-b53028cf-7c55-4944-b061-a8cbfe0e1ed5 service nova] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Received unexpected event network-vif-plugged-098efb5c-4d22-4abc-b8bc-3beb7dbf6252 for instance with vm_state deleted and task_state None.
Aug 16 17:14:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Verify base images {{(pid=73450) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Image id f5d06caa-7cbd-45eb-944b-5dc2a22ca419 yields fingerprint fb02d80349bde7163778062af8767d7137dfda0e {{(pid=73450) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] image f5d06caa-7cbd-45eb-944b-5dc2a22ca419 at (/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e): checking
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] image f5d06caa-7cbd-45eb-944b-5dc2a22ca419 at (/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e): image is in use {{(pid=73450) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73450) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] 496a4c19-48b4-4617-be19-823c1f3c2a0b is a valid instance name {{(pid=73450) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] 496a4c19-48b4-4617-be19-823c1f3c2a0b has a disk file {{(pid=73450) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 496a4c19-48b4-4617-be19-823c1f3c2a0b is backed by fb02d80349bde7163778062af8767d7137dfda0e {{(pid=73450) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828
Aug 16 17:14:35 user nova-compute[73450]: WARNING nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Unknown base file: /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Active base files: /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Removable base files: /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680 /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795 /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247 /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783 /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600 /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167 /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828 /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e5b5219960ce686eb28af3d848ee07a680860680
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1ba85543d36f740d1f3b363430bc64a6563a0795
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ebb9fc5c213e9361103bbab9e742148a7d65247
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f86195247aafbb4019d46a3934ef07d50ca4b783
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d110de1d21ca6ce7d7ea21b9442c720245326600
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a09ce228f023502eb4efbf4e120534dd849e1167
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bc23d070d13ac8dd570d31a40623001be032798d
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6f44f31260eace084a8f9f61218b344f28759828
Aug 16 17:14:35 user nova-compute[73450]: INFO nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dbb6306e843fce651c8aed3361799c67e33a5a91
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Verification complete {{(pid=73450) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Verify swap images {{(pid=73450) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG nova.virt.libvirt.imagecache [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Verify ephemeral images {{(pid=73450) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 17:14:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:36 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692206061.9446783, b7c78901-d528-42d4-b9db-efcd79218d5c => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:14:36 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] VM Stopped (Lifecycle Event)
Aug 16 17:14:36 user nova-compute[73450]: DEBUG nova.compute.manager [None req-00294df7-fcd7-45ac-942c-be27d998ba06 None None] [instance: b7c78901-d528-42d4-b9db-efcd79218d5c] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:14:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:14:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:14:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:14:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:14:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:14:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:14:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Updating instance_info_cache with network_info: [{"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-496a4c19-48b4-4617-be19-823c1f3c2a0b" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:15:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:15:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:15:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=23.901432037353516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 496a4c19-48b4-4617-be19-823c1f3c2a0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:15:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:15:21 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:15:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:15:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:15:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:15:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:15:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:15:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:32 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 17:15:32 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 17:15:33 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:15:33 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 17:15:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:15:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:15:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:15:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:51 user nova-compute[73450]: INFO nova.compute.manager [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Terminating instance
Aug 16 17:15:51 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-f0f581a4-ceea-4623-bb74-32cec66b826c req-b5946fd2-6c3a-491b-a85c-ecaf141031e9 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-vif-unplugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f0f581a4-ceea-4623-bb74-32cec66b826c req-b5946fd2-6c3a-491b-a85c-ecaf141031e9 service nova] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f0f581a4-ceea-4623-bb74-32cec66b826c req-b5946fd2-6c3a-491b-a85c-ecaf141031e9 service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f0f581a4-ceea-4623-bb74-32cec66b826c req-b5946fd2-6c3a-491b-a85c-ecaf141031e9 service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-f0f581a4-ceea-4623-bb74-32cec66b826c req-b5946fd2-6c3a-491b-a85c-ecaf141031e9 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] No waiting events found dispatching network-vif-unplugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-f0f581a4-ceea-4623-bb74-32cec66b826c req-b5946fd2-6c3a-491b-a85c-ecaf141031e9 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-vif-unplugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:15:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Instance destroyed successfully.
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.objects.instance [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lazy-loading 'resources' on Instance uuid 496a4c19-48b4-4617-be19-823c1f3c2a0b {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1011886858',display_name='tempest-VolumesActionsTest-instance-1011886858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1011886858',id=50,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='059ec562890145a68e233bc28d85ca9f',ramdisk_id='',reservation_id='r-8bgb60lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-437822511',owner_user_name='tempest-VolumesActionsTest-437822511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:14:07Z,user_data=None,user_id='b35b154180604b04929cbdac03936e84',uuid=496a4c19-48b4-4617-be19-823c1f3c2a0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converting VIF {"id": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "address": "fa:16:3e:78:c4:40", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68db2cf9-44", "ovs_interfaceid": "68db2cf9-445e-44b7-9fa0-62b5bef13b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG os_vif [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68db2cf9-44, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:15:52 user nova-compute[73450]: INFO os_vif [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c4:40,bridge_name='br-int',has_traffic_filtering=True,id=68db2cf9-445e-44b7-9fa0-62b5bef13b6d,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68db2cf9-44')
Aug 16 17:15:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Deleting instance files /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b_del
Aug 16 17:15:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Deletion of /opt/stack/data/nova/instances/496a4c19-48b4-4617-be19-823c1f3c2a0b_del complete
Aug 16 17:15:52 user nova-compute[73450]: INFO nova.compute.manager [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 17:15:52 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:15:52 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:15:53 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:15:53 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Took 0.51 seconds to deallocate network for instance.
Aug 16 17:15:53 user nova-compute[73450]: DEBUG nova.compute.manager [req-3c0785df-ce8d-43cb-a4bd-7971dc0e75b1 req-a6985b2f-6e02-420e-a42b-e4d685be380d service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-vif-deleted-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:15:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:53 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:15:53 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:15:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:53 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Deleted allocations for instance 496a4c19-48b4-4617-be19-823c1f3c2a0b
Aug 16 17:15:53 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fe17921e-7ce7-4a3c-b428-d383a0395e58 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.666s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0041b61-3d88-4744-81ce-b924d19fcfae req-bcdd4129-bf52-496a-8723-09b0e9af6b29 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received event network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:15:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b0041b61-3d88-4744-81ce-b924d19fcfae req-bcdd4129-bf52-496a-8723-09b0e9af6b29 service nova] Acquiring lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:15:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b0041b61-3d88-4744-81ce-b924d19fcfae req-bcdd4129-bf52-496a-8723-09b0e9af6b29 service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:15:54 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-b0041b61-3d88-4744-81ce-b924d19fcfae req-bcdd4129-bf52-496a-8723-09b0e9af6b29 service nova] Lock "496a4c19-48b4-4617-be19-823c1f3c2a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:15:54 user nova-compute[73450]: DEBUG nova.compute.manager [req-b0041b61-3d88-4744-81ce-b924d19fcfae req-bcdd4129-bf52-496a-8723-09b0e9af6b29 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] No waiting events found dispatching network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:15:54 user nova-compute[73450]: WARNING nova.compute.manager [req-b0041b61-3d88-4744-81ce-b924d19fcfae req-bcdd4129-bf52-496a-8723-09b0e9af6b29 service nova] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Received unexpected event network-vif-plugged-68db2cf9-445e-44b7-9fa0-62b5bef13b6d for instance with vm_state deleted and task_state None.
Aug 16 17:15:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:16:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:16:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:16:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:07 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692206152.5246968, 496a4c19-48b4-4617-be19-823c1f3c2a0b => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:16:07 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] VM Stopped (Lifecycle Event)
Aug 16 17:16:07 user nova-compute[73450]: DEBUG nova.compute.manager [None req-88aa6674-bce0-4e39-8509-2c8ffa006a7a None None] [instance: 496a4c19-48b4-4617-be19-823c1f3c2a0b] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:16:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:13 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:16:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:16:15 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8901MB free_disk=23.927276611328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:16:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:16:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:16:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:16:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:16:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:16:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:16:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:16:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:16:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:16:43 user nova-compute[73450]: INFO nova.compute.claims [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Claim successful on node user
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:16:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.policy [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b35b154180604b04929cbdac03936e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ec562890145a68e233bc28d85ca9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:16:43 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:16:43 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Creating image(s)
Aug 16 17:16:43 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "/opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "/opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.174s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "fb02d80349bde7163778062af8767d7137dfda0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.169s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk 1073741824 {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e,backing_fmt=raw /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk 1073741824" returned: 0 in 0.051s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "fb02d80349bde7163778062af8767d7137dfda0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Successfully created port: 7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb02d80349bde7163778062af8767d7137dfda0e --force-share --output=json" returned: 0 in 0.190s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk. size=1073741824 {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG nova.virt.disk.api [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Cannot resize image /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk to a smaller size. {{(pid=73450) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG nova.objects.instance [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lazy-loading 'migration_context' on Instance uuid 4fffa9e7-5048-453e-bf58-dff44bcb294f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Created local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Ensure instance console log exists: /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:44 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Successfully updated port: 7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquired lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-changed-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.compute.manager [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Refreshing instance network info cache due to event network-changed-7e65f94c-13eb-4f53-8760-4476ffdb192e. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] Acquiring lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.neutron [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updating instance_info_cache with network_info: [{"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Releasing lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Instance network_info: |[{"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] Acquired lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.neutron [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Refreshing network info cache for port 7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Start _get_guest_xml network_info=[{"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'image_id': 'f5d06caa-7cbd-45eb-944b-5dc2a22ca419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:16:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:16:45 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T16:35:04Z,direct_url=<?>,disk_format='qcow2',id=f5d06caa-7cbd-45eb-944b-5dc2a22ca419,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053b6ba3f029484e96d0d210f0c815dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T16:35:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2083306447',display_name='tempest-VolumesActionsTest-instance-2083306447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2083306447',id=51,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='059ec562890145a68e233bc28d85ca9f',ramdisk_id='',reservation_id='r-n33px0qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-437822511',owner_user_name='tempest-VolumesActionsTest-437822511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:16:44Z,user_data=None,user_id='b35b154180604b04929cbdac03936e84',uuid=4fffa9e7-5048-453e-bf58-dff44bcb294f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converting VIF {"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.objects.instance [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fffa9e7-5048-453e-bf58-dff44bcb294f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:16:45 user nova-compute[73450]:   <uuid>4fffa9e7-5048-453e-bf58-dff44bcb294f</uuid>
Aug 16 17:16:45 user nova-compute[73450]:   <name>instance-00000033</name>
Aug 16 17:16:45 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:16:45 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:16:45 user nova-compute[73450]:   <metadata>
Aug 16 17:16:45 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:16:45 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:16:45 user nova-compute[73450]:       <nova:name>tempest-VolumesActionsTest-instance-2083306447</nova:name>
Aug 16 17:16:45 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:16:45</nova:creationTime>
Aug 16 17:16:45 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:16:45 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:16:45 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:16:45 user nova-compute[73450]:       <nova:owner>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:user uuid="b35b154180604b04929cbdac03936e84">tempest-VolumesActionsTest-437822511-project-member</nova:user>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:project uuid="059ec562890145a68e233bc28d85ca9f">tempest-VolumesActionsTest-437822511</nova:project>
Aug 16 17:16:45 user nova-compute[73450]:       </nova:owner>
Aug 16 17:16:45 user nova-compute[73450]:       <nova:root type="image" uuid="f5d06caa-7cbd-45eb-944b-5dc2a22ca419"/>
Aug 16 17:16:45 user nova-compute[73450]:       <nova:ports>
Aug 16 17:16:45 user nova-compute[73450]:         <nova:port uuid="7e65f94c-13eb-4f53-8760-4476ffdb192e">
Aug 16 17:16:45 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 17:16:45 user nova-compute[73450]:         </nova:port>
Aug 16 17:16:45 user nova-compute[73450]:       </nova:ports>
Aug 16 17:16:45 user nova-compute[73450]:     </nova:instance>
Aug 16 17:16:45 user nova-compute[73450]:   </metadata>
Aug 16 17:16:45 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:16:45 user nova-compute[73450]:     <system>
Aug 16 17:16:45 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:16:45 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:16:45 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:16:45 user nova-compute[73450]:       <entry name="serial">4fffa9e7-5048-453e-bf58-dff44bcb294f</entry>
Aug 16 17:16:45 user nova-compute[73450]:       <entry name="uuid">4fffa9e7-5048-453e-bf58-dff44bcb294f</entry>
Aug 16 17:16:45 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:16:45 user nova-compute[73450]:     </system>
Aug 16 17:16:45 user nova-compute[73450]:   </sysinfo>
Aug 16 17:16:45 user nova-compute[73450]:   <os>
Aug 16 17:16:45 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:16:45 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:16:45 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:16:45 user nova-compute[73450]:   </os>
Aug 16 17:16:45 user nova-compute[73450]:   <features>
Aug 16 17:16:45 user nova-compute[73450]:     <acpi/>
Aug 16 17:16:45 user nova-compute[73450]:     <apic/>
Aug 16 17:16:45 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:16:45 user nova-compute[73450]:   </features>
Aug 16 17:16:45 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:16:45 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:16:45 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:16:45 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:16:45 user nova-compute[73450]:   </clock>
Aug 16 17:16:45 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:16:45 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:16:45 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:16:45 user nova-compute[73450]:   </cpu>
Aug 16 17:16:45 user nova-compute[73450]:   <devices>
Aug 16 17:16:45 user nova-compute[73450]:     <disk type="file" device="disk">
Aug 16 17:16:45 user nova-compute[73450]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 17:16:45 user nova-compute[73450]:       <source file="/opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk"/>
Aug 16 17:16:45 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:16:45 user nova-compute[73450]:     </disk>
Aug 16 17:16:45 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:16:45 user nova-compute[73450]:       <mac address="fa:16:3e:45:23:0c"/>
Aug 16 17:16:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:16:45 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:16:45 user nova-compute[73450]:       <target dev="tap7e65f94c-13"/>
Aug 16 17:16:45 user nova-compute[73450]:     </interface>
Aug 16 17:16:45 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:16:45 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/console.log" append="off"/>
Aug 16 17:16:45 user nova-compute[73450]:     </serial>
Aug 16 17:16:45 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:16:45 user nova-compute[73450]:     <video>
Aug 16 17:16:45 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:16:45 user nova-compute[73450]:     </video>
Aug 16 17:16:45 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:16:45 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:16:45 user nova-compute[73450]:     </rng>
Aug 16 17:16:45 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:16:45 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:16:45 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:16:45 user nova-compute[73450]:     </memballoon>
Aug 16 17:16:45 user nova-compute[73450]:   </devices>
Aug 16 17:16:45 user nova-compute[73450]: </domain>
Aug 16 17:16:45 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2083306447',display_name='tempest-VolumesActionsTest-instance-2083306447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2083306447',id=51,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='059ec562890145a68e233bc28d85ca9f',ramdisk_id='',reservation_id='r-n33px0qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-437822511',owner_user_name='tempest-VolumesActionsTest-437822511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:16:44Z,user_data=None,user_id='b35b154180604b04929cbdac03936e84',uuid=4fffa9e7-5048-453e-bf58-dff44bcb294f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converting VIF {"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG os_vif [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e65f94c-13, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e65f94c-13, col_values=(('external_ids', {'iface-id': '7e65f94c-13eb-4f53-8760-4476ffdb192e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:23:0c', 'vm-uuid': '4fffa9e7-5048-453e-bf58-dff44bcb294f'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:45 user nova-compute[73450]: INFO os_vif [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13')
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:16:45 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] No VIF found with MAC fa:16:3e:45:23:0c, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:16:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updated VIF entry in instance network info cache for port 7e65f94c-13eb-4f53-8760-4476ffdb192e. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:16:46 user nova-compute[73450]: DEBUG nova.network.neutron [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updating instance_info_cache with network_info: [{"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:16:46 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d1564e3f-f33f-4434-a6d5-29b828c0391a req-268c74eb-0544-402a-98c3-58104784e2fa service nova] Releasing lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-9e2d32e6-d638-4f74-ad40-bab4bd538e08 req-0fbf7dcd-c80a-4d05-a76b-815fdc9ac5f3 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9e2d32e6-d638-4f74-ad40-bab4bd538e08 req-0fbf7dcd-c80a-4d05-a76b-815fdc9ac5f3 service nova] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9e2d32e6-d638-4f74-ad40-bab4bd538e08 req-0fbf7dcd-c80a-4d05-a76b-815fdc9ac5f3 service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-9e2d32e6-d638-4f74-ad40-bab4bd538e08 req-0fbf7dcd-c80a-4d05-a76b-815fdc9ac5f3 service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG nova.compute.manager [req-9e2d32e6-d638-4f74-ad40-bab4bd538e08 req-0fbf7dcd-c80a-4d05-a76b-815fdc9ac5f3 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] No waiting events found dispatching network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:16:47 user nova-compute[73450]: WARNING nova.compute.manager [req-9e2d32e6-d638-4f74-ad40-bab4bd538e08 req-0fbf7dcd-c80a-4d05-a76b-815fdc9ac5f3 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received unexpected event network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e for instance with vm_state building and task_state spawning.
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-c74906d4-8e77-4422-b532-b34be2e7dc7c req-7ad2a325-3976-4568-8ad7-78b6acdc8f5e service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c74906d4-8e77-4422-b532-b34be2e7dc7c req-7ad2a325-3976-4568-8ad7-78b6acdc8f5e service nova] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c74906d4-8e77-4422-b532-b34be2e7dc7c req-7ad2a325-3976-4568-8ad7-78b6acdc8f5e service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c74906d4-8e77-4422-b532-b34be2e7dc7c req-7ad2a325-3976-4568-8ad7-78b6acdc8f5e service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [req-c74906d4-8e77-4422-b532-b34be2e7dc7c req-7ad2a325-3976-4568-8ad7-78b6acdc8f5e service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] No waiting events found dispatching network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:16:49 user nova-compute[73450]: WARNING nova.compute.manager [req-c74906d4-8e77-4422-b532-b34be2e7dc7c req-7ad2a325-3976-4568-8ad7-78b6acdc8f5e service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received unexpected event network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e for instance with vm_state building and task_state spawning.
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206209.6018393, 4fffa9e7-5048-453e-bf58-dff44bcb294f => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] VM Resumed (Lifecycle Event)
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Instance spawned successfully.
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206209.6049576, 4fffa9e7-5048-453e-bf58-dff44bcb294f => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] VM Started (Lifecycle Event)
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 16 17:16:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:16:49 user nova-compute[73450]: INFO nova.compute.manager [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Took 6.32 seconds to build instance.
Aug 16 17:16:49 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-19184c1a-e299-4eb6-886d-b9bc36eafcb4 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:16:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:16:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:17:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:17:16 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=23.896835327148438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 4fffa9e7-5048-453e-bf58-dff44bcb294f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:17:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid 4fffa9e7-5048-453e-bf58-dff44bcb294f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updating instance_info_cache with network_info: [{"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:19 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:17:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:24 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:17:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:25 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Starting instance... {{(pid=73450) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:17:37 user nova-compute[73450]: INFO nova.compute.claims [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Claim successful on node user
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Start building networks asynchronously for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Allocating IP information in the background. {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] allocate_for_instance() {{(pid=73450) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 17:17:37 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Start building block device mappings for instance. {{(pid=73450) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.policy [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56f1e5a175be4568af6dbdf137ec9b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fc377c07124027a15cb195f0f776fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73450) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 17:17:37 user nova-compute[73450]: INFO nova.virt.block_device [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Booting with volume 9a5f469e-40fb-4dbb-854f-fa74bb8b8736 at /dev/vda
Aug 16 17:17:37 user nova-compute[73450]: DEBUG os_brick.utils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d871954-29ef-4cae-af17-bcce77fcea30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[60980744-9154-4e81-8896-4b2a72199f05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc1dd5-3e8d-4678-b8ad-ef73b04699b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb32f929-8164-437f-ac6f-4395f815e249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:17:37 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:17:37 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b72a4-e074-4ffb-89f1-4d46e34727b2]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG os_brick.utils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:17:37 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating existing volume attachment record: 9a7a8283-70a4-4998-8de2-065036a264c9 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:17:38 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Successfully created port: e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Successfully updated port: e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing instance network info cache due to event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance cache missing network info. {{(pid=73450) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.network.neutron [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance network_info: |[{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73450) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:17:39 user nova-compute[73450]: DEBUG nova.network.neutron [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:17:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated VIF entry in instance network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:17:40 user nova-compute[73450]: DEBUG nova.network.neutron [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:17:40 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-c0966f69-ee16-462e-b805-80df2d0a3727 req-089e878b-7767-41ab-8729-abc6b48e21e5 service nova] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:17:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:17:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:17:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:17:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:17:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Start spawning the instance on the hypervisor. {{(pid=73450) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:17:47 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Creating image(s)
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Ensure instance console log exists: /opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Start _get_guest_xml network_info=[{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '9a7a8283-70a4-4998-8de2-065036a264c9', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '289e099e-6904-48d0-beb9-00ef803da779', 'attached_at': '', 'detached_at': '', 'volume_id': '9a5f469e-40fb-4dbb-854f-fa74bb8b8736', 'serial': '9a5f469e-40fb-4dbb-854f-fa74bb8b8736'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:17:47 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:17:47 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:17:47 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:17:47 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:17:47 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[708cedbd-5b3b-4275-af25-297036bda45d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:17:47 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1c565f-af30-4e70-8653-05ffe6ca3303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736] added
Aug 16 17:17:47 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b451d5a4-d32e-4f1d-b943-ae5d2a876ee7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3a087-3077-42f2-8da5-ada1e29259c2]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjpBorHs {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjpBorHs" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f9d2b-1a95-410f-ad27-e982e0ce47e4]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjpBorHs'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3612f93-bed8-4dd9-8773-3a91039fa8d0]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a7aed-7ea6-4326-bb2e-5cece0eee89e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:17:47 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:17:47 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:17:47 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:17:47 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:17:47 user nova-compute[73450]: 
Aug 16 17:17:47 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2236e534-69d4-4513-887b-630ea0aa0a1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]
Aug 16 17:17:48 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.
Aug 16 17:17:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b106b68e-d0de-4dbe-86d2-c569701cb089]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb27ef-bec0-4421-a5c3-b3b9ae41013b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:17:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:17:48 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53069ee-36e4-4d05-8665-5eabf5a7ea2e]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:17:48 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23466626331333338', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466626331333338', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1548028814',display_name='tempest-TestShelveInstance-server-1548028814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1548028814',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEg1RA7BWmGAZ9ksizXdsQlZvbkQMy9T7CtI1FahCapmwzHjedOSUFCmSYuxZmDadFvoV3sVtTw0rEbTlIjaK9JEx892u6XfErE9cPvB1vXaMcXs9WgwAmm88PyHJOorw==',key_name='tempest-TestShelveInstance-1066272739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62fc377c07124027a15cb195f0f776fc',ramdisk_id='',reservation_id='r-w6ofuokq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1118976337',owner_user_name='tempest-TestShelveInstance-1118976337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:17:38Z,user_data=None,user_id='56f1e5a175be4568af6dbdf137ec9b78',uuid=289e099e-6904-48d0-beb9-00ef803da779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converting VIF {"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.objects.instance [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'pci_devices' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:17:49 user nova-compute[73450]:   <uuid>289e099e-6904-48d0-beb9-00ef803da779</uuid>
Aug 16 17:17:49 user nova-compute[73450]:   <name>instance-00000034</name>
Aug 16 17:17:49 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:17:49 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:17:49 user nova-compute[73450]:   <metadata>
Aug 16 17:17:49 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:17:49 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:17:49 user nova-compute[73450]:       <nova:name>tempest-TestShelveInstance-server-1548028814</nova:name>
Aug 16 17:17:49 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:17:47</nova:creationTime>
Aug 16 17:17:49 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:17:49 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:17:49 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:17:49 user nova-compute[73450]:       <nova:owner>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:user uuid="56f1e5a175be4568af6dbdf137ec9b78">tempest-TestShelveInstance-1118976337-project-member</nova:user>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:project uuid="62fc377c07124027a15cb195f0f776fc">tempest-TestShelveInstance-1118976337</nova:project>
Aug 16 17:17:49 user nova-compute[73450]:       </nova:owner>
Aug 16 17:17:49 user nova-compute[73450]:       <nova:ports>
Aug 16 17:17:49 user nova-compute[73450]:         <nova:port uuid="e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161">
Aug 16 17:17:49 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 17:17:49 user nova-compute[73450]:         </nova:port>
Aug 16 17:17:49 user nova-compute[73450]:       </nova:ports>
Aug 16 17:17:49 user nova-compute[73450]:     </nova:instance>
Aug 16 17:17:49 user nova-compute[73450]:   </metadata>
Aug 16 17:17:49 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:17:49 user nova-compute[73450]:     <system>
Aug 16 17:17:49 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:17:49 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:17:49 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:17:49 user nova-compute[73450]:       <entry name="serial">289e099e-6904-48d0-beb9-00ef803da779</entry>
Aug 16 17:17:49 user nova-compute[73450]:       <entry name="uuid">289e099e-6904-48d0-beb9-00ef803da779</entry>
Aug 16 17:17:49 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:17:49 user nova-compute[73450]:     </system>
Aug 16 17:17:49 user nova-compute[73450]:   </sysinfo>
Aug 16 17:17:49 user nova-compute[73450]:   <os>
Aug 16 17:17:49 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:17:49 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:17:49 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:17:49 user nova-compute[73450]:   </os>
Aug 16 17:17:49 user nova-compute[73450]:   <features>
Aug 16 17:17:49 user nova-compute[73450]:     <acpi/>
Aug 16 17:17:49 user nova-compute[73450]:     <apic/>
Aug 16 17:17:49 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:17:49 user nova-compute[73450]:   </features>
Aug 16 17:17:49 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:17:49 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:17:49 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:17:49 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:17:49 user nova-compute[73450]:   </clock>
Aug 16 17:17:49 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:17:49 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:17:49 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:17:49 user nova-compute[73450]:   </cpu>
Aug 16 17:17:49 user nova-compute[73450]:   <devices>
Aug 16 17:17:49 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 17:17:49 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:17:49 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 17:17:49 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:17:49 user nova-compute[73450]:       <serial>9a5f469e-40fb-4dbb-854f-fa74bb8b8736</serial>
Aug 16 17:17:49 user nova-compute[73450]:     </disk>
Aug 16 17:17:49 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:17:49 user nova-compute[73450]:       <mac address="fa:16:3e:ea:2a:91"/>
Aug 16 17:17:49 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:17:49 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:17:49 user nova-compute[73450]:       <target dev="tape3f8ddac-46"/>
Aug 16 17:17:49 user nova-compute[73450]:     </interface>
Aug 16 17:17:49 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:17:49 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779/console.log" append="off"/>
Aug 16 17:17:49 user nova-compute[73450]:     </serial>
Aug 16 17:17:49 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:17:49 user nova-compute[73450]:     <video>
Aug 16 17:17:49 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:17:49 user nova-compute[73450]:     </video>
Aug 16 17:17:49 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:17:49 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:17:49 user nova-compute[73450]:     </rng>
Aug 16 17:17:49 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:17:49 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:17:49 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:17:49 user nova-compute[73450]:     </memballoon>
Aug 16 17:17:49 user nova-compute[73450]:   </devices>
Aug 16 17:17:49 user nova-compute[73450]: </domain>
Aug 16 17:17:49 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1548028814',display_name='tempest-TestShelveInstance-server-1548028814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1548028814',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEg1RA7BWmGAZ9ksizXdsQlZvbkQMy9T7CtI1FahCapmwzHjedOSUFCmSYuxZmDadFvoV3sVtTw0rEbTlIjaK9JEx892u6XfErE9cPvB1vXaMcXs9WgwAmm88PyHJOorw==',key_name='tempest-TestShelveInstance-1066272739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62fc377c07124027a15cb195f0f776fc',ramdisk_id='',reservation_id='r-w6ofuokq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1118976337',owner_user_name='tempest-TestShelveInstance-1118976337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T17:17:38Z,user_data=None,user_id='56f1e5a175be4568af6dbdf137ec9b78',uuid=289e099e-6904-48d0-beb9-00ef803da779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converting VIF {"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG os_vif [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3f8ddac-46, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3f8ddac-46, col_values=(('external_ids', {'iface-id': 'e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:2a:91', 'vm-uuid': '289e099e-6904-48d0-beb9-00ef803da779'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:49 user nova-compute[73450]: INFO os_vif [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46')
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:17:49 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] No VIF found with MAC fa:16:3e:ea:2a:91, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-07acd7d2-d469-4a03-a380-e3bac1129852 req-a806e24e-79c4-4011-94ab-a91148b91496 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-07acd7d2-d469-4a03-a380-e3bac1129852 req-a806e24e-79c4-4011-94ab-a91148b91496 service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-07acd7d2-d469-4a03-a380-e3bac1129852 req-a806e24e-79c4-4011-94ab-a91148b91496 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-07acd7d2-d469-4a03-a380-e3bac1129852 req-a806e24e-79c4-4011-94ab-a91148b91496 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:50 user nova-compute[73450]: DEBUG nova.compute.manager [req-07acd7d2-d469-4a03-a380-e3bac1129852 req-a806e24e-79c4-4011-94ab-a91148b91496 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:17:50 user nova-compute[73450]: WARNING nova.compute.manager [req-07acd7d2-d469-4a03-a380-e3bac1129852 req-a806e24e-79c4-4011-94ab-a91148b91496 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state building and task_state spawning.
Aug 16 17:17:50 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206272.5004733, 289e099e-6904-48d0-beb9-00ef803da779 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] VM Resumed (Lifecycle Event)
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance spawned successfully.
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Found default for hw_cdrom_bus of ide {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Found default for hw_disk_bus of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Found default for hw_input_bus of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Found default for hw_pointer_model of None {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Found default for hw_video_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Found default for hw_vif_model of virtio {{(pid=73450) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206272.5018337, 289e099e-6904-48d0-beb9-00ef803da779 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] VM Started (Lifecycle Event)
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:17:52 user nova-compute[73450]: INFO nova.compute.manager [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Took 15.33 seconds to build instance.
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-daa41105-7e86-43a7-b657-558d48ab4049 req-652035cf-9769-4908-8b5e-a00526a4bfa3 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-daa41105-7e86-43a7-b657-558d48ab4049 req-652035cf-9769-4908-8b5e-a00526a4bfa3 service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-daa41105-7e86-43a7-b657-558d48ab4049 req-652035cf-9769-4908-8b5e-a00526a4bfa3 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-daa41105-7e86-43a7-b657-558d48ab4049 req-652035cf-9769-4908-8b5e-a00526a4bfa3 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:52 user nova-compute[73450]: DEBUG nova.compute.manager [req-daa41105-7e86-43a7-b657-558d48ab4049 req-652035cf-9769-4908-8b5e-a00526a4bfa3 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:17:52 user nova-compute[73450]: WARNING nova.compute.manager [req-daa41105-7e86-43a7-b657-558d48ab4049 req-652035cf-9769-4908-8b5e-a00526a4bfa3 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state active and task_state None.
Aug 16 17:17:52 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-b5be1362-529b-4eb2-98ab-ed6f06ffb0ed tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.428s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:17:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:17:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:18:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:15 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid 4fffa9e7-5048-453e-bf58-dff44bcb294f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updating instance_info_cache with network_info: [{"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-4fffa9e7-5048-453e-bf58-dff44bcb294f" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:18:16 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:18:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:18:17 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=23.88614273071289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 4fffa9e7-5048-453e-bf58-dff44bcb294f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 289e099e-6904-48d0-beb9-00ef803da779 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:18:17 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:20 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:21 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:21 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:18:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:18:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:34 user nova-compute[73450]: INFO nova.compute.manager [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Terminating instance
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.compute.manager [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-5debbc1b-9830-4fd9-97ff-b9ba4b60cd98 req-163e8166-f63d-4eb1-8a1e-d8cabdc168ad service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-vif-unplugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5debbc1b-9830-4fd9-97ff-b9ba4b60cd98 req-163e8166-f63d-4eb1-8a1e-d8cabdc168ad service nova] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5debbc1b-9830-4fd9-97ff-b9ba4b60cd98 req-163e8166-f63d-4eb1-8a1e-d8cabdc168ad service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-5debbc1b-9830-4fd9-97ff-b9ba4b60cd98 req-163e8166-f63d-4eb1-8a1e-d8cabdc168ad service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-5debbc1b-9830-4fd9-97ff-b9ba4b60cd98 req-163e8166-f63d-4eb1-8a1e-d8cabdc168ad service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] No waiting events found dispatching network-vif-unplugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-5debbc1b-9830-4fd9-97ff-b9ba4b60cd98 req-163e8166-f63d-4eb1-8a1e-d8cabdc168ad service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-vif-unplugged-7e65f94c-13eb-4f53-8760-4476ffdb192e for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Instance destroyed successfully.
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.objects.instance [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lazy-loading 'resources' on Instance uuid 4fffa9e7-5048-453e-bf58-dff44bcb294f {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2083306447',display_name='tempest-VolumesActionsTest-instance-2083306447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2083306447',id=51,image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='059ec562890145a68e233bc28d85ca9f',ramdisk_id='',reservation_id='r-n33px0qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5d06caa-7cbd-45eb-944b-5dc2a22ca419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-437822511',owner_user_name='tempest-VolumesActionsTest-437822511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:16:50Z,user_data=None,user_id='b35b154180604b04929cbdac03936e84',uuid=4fffa9e7-5048-453e-bf58-dff44bcb294f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converting VIF {"id": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "address": "fa:16:3e:45:23:0c", "network": {"id": "f83d7478-ace7-4619-b18c-fa741ea5bc00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2038965746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "059ec562890145a68e233bc28d85ca9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e65f94c-13", "ovs_interfaceid": "7e65f94c-13eb-4f53-8760-4476ffdb192e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG os_vif [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e65f94c-13, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:18:34 user nova-compute[73450]: INFO os_vif [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:23:0c,bridge_name='br-int',has_traffic_filtering=True,id=7e65f94c-13eb-4f53-8760-4476ffdb192e,network=Network(f83d7478-ace7-4619-b18c-fa741ea5bc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e65f94c-13')
Aug 16 17:18:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Deleting instance files /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f_del
Aug 16 17:18:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Deletion of /opt/stack/data/nova/instances/4fffa9e7-5048-453e-bf58-dff44bcb294f_del complete
Aug 16 17:18:34 user nova-compute[73450]: INFO nova.compute.manager [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 16 17:18:34 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:18:34 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:18:35 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:18:35 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Took 0.53 seconds to deallocate network for instance.
Aug 16 17:18:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:35 user nova-compute[73450]: DEBUG nova.compute.manager [req-8f482056-3281-4fe7-880e-6f5c158e4376 req-1e0424d6-2fd7-4abc-a3ce-f6ab53adb099 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-vif-deleted-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:18:35 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:18:35 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:18:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:35 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Deleted allocations for instance 4fffa9e7-5048-453e-bf58-dff44bcb294f
Aug 16 17:18:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-7c906d25-c2dc-45ed-a28c-367a79b18ba0 tempest-VolumesActionsTest-437822511 tempest-VolumesActionsTest-437822511-project-member] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa3fba04-4b9f-4583-89bc-ee1362f17882 req-fca0c3f3-c5af-4855-8f90-6352e68310a0 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received event network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:18:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa3fba04-4b9f-4583-89bc-ee1362f17882 req-fca0c3f3-c5af-4855-8f90-6352e68310a0 service nova] Acquiring lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:18:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa3fba04-4b9f-4583-89bc-ee1362f17882 req-fca0c3f3-c5af-4855-8f90-6352e68310a0 service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:18:36 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-aa3fba04-4b9f-4583-89bc-ee1362f17882 req-fca0c3f3-c5af-4855-8f90-6352e68310a0 service nova] Lock "4fffa9e7-5048-453e-bf58-dff44bcb294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:18:36 user nova-compute[73450]: DEBUG nova.compute.manager [req-aa3fba04-4b9f-4583-89bc-ee1362f17882 req-fca0c3f3-c5af-4855-8f90-6352e68310a0 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] No waiting events found dispatching network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:18:36 user nova-compute[73450]: WARNING nova.compute.manager [req-aa3fba04-4b9f-4583-89bc-ee1362f17882 req-fca0c3f3-c5af-4855-8f90-6352e68310a0 service nova] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Received unexpected event network-vif-plugged-7e65f94c-13eb-4f53-8760-4476ffdb192e for instance with vm_state deleted and task_state None.
Aug 16 17:18:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692206314.6086328, 4fffa9e7-5048-453e-bf58-dff44bcb294f => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:18:49 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] VM Stopped (Lifecycle Event)
Aug 16 17:18:49 user nova-compute[73450]: DEBUG nova.compute.manager [None req-8c3cbcba-22de-4847-86de-ed1e67937b80 None None] [instance: 4fffa9e7-5048-453e-bf58-dff44bcb294f] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:18:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:18:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:19:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:19:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:19:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:19:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:19:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:19:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:19:16 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:19:18 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:19:18 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=23.91326141357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 289e099e-6904-48d0-beb9-00ef803da779 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:19:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:23 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:19:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:19:27 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:19:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG nova.compute.manager [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing instance network info cache due to event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated VIF entry in instance network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG nova.network.neutron [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:19:29 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d771cac3-188d-4dd5-a0c9-72aa984f92ed req-a4cec6d2-aabc-41ef-8ca0-1de4728b8238 service nova] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:19:30 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:19:30 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:19:30 user nova-compute[73450]: INFO nova.compute.manager [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Shelve offloading
Aug 16 17:19:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-182aa9c9-4764-48af-af21-103a90cde8a8 req-9f180771-3840-4297-bf21-ce053c845ee3 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-unplugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-182aa9c9-4764-48af-af21-103a90cde8a8 req-9f180771-3840-4297-bf21-ce053c845ee3 service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-182aa9c9-4764-48af-af21-103a90cde8a8 req-9f180771-3840-4297-bf21-ce053c845ee3 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-182aa9c9-4764-48af-af21-103a90cde8a8 req-9f180771-3840-4297-bf21-ce053c845ee3 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG nova.compute.manager [req-182aa9c9-4764-48af-af21-103a90cde8a8 req-9f180771-3840-4297-bf21-ce053c845ee3 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-unplugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:19:31 user nova-compute[73450]: WARNING nova.compute.manager [req-182aa9c9-4764-48af-af21-103a90cde8a8 req-9f180771-3840-4297-bf21-ce053c845ee3 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-unplugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state active and task_state shelving.
Aug 16 17:19:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:31 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance destroyed successfully.
Aug 16 17:19:31 user nova-compute[73450]: DEBUG nova.compute.manager [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:19:31 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.network.neutron [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:19:32 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance destroyed successfully.
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.objects.instance [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'resources' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1548028814',display_name='tempest-TestShelveInstance-server-1548028814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1548028814',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEg1RA7BWmGAZ9ksizXdsQlZvbkQMy9T7CtI1FahCapmwzHjedOSUFCmSYuxZmDadFvoV3sVtTw0rEbTlIjaK9JEx892u6XfErE9cPvB1vXaMcXs9WgwAmm88PyHJOorw==',key_name='tempest-TestShelveInstance-1066272739',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62fc377c07124027a15cb195f0f776fc',ramdisk_id='',reservation_id='r-w6ofuokq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1118976337',owner_user_name='tempest-TestShelveInstance-1118976337-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:17:53Z,user_data=None,user_id='56f1e5a175be4568af6dbdf137ec9b78',uuid=289e099e-6904-48d0-beb9-00ef803da779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converting VIF {"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG os_vif [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3f8ddac-46, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:19:32 user nova-compute[73450]: INFO os_vif [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46')
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.compute.manager [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing instance network info cache due to event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.network.neutron [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:19:32 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:19:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d4adf-8863-4400-862a-ab4db4d60d32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:32 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b6ec0-57fc-4081-a7ea-7b6ef63583b0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:19:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:19:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270786c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6774e390-4022-4b0b-b22e-57959d7bbe6d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52c4b4-2fdc-4e71-880b-2766e1aaa7f9]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef715a36-bd98-4c23-93dd-4cfec55fefad]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbe7ea-59e6-44a4-baed-026a7d52a6f4]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f441dae-8faf-4fa6-82c8-c4f08ad508d7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d2fec-18e4-49c2-92ac-b7a3a1de6b6c]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]
Aug 16 17:19:33 user nova-compute[73450]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.
Aug 16 17:19:33 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640bf65-e813-4f08-b669-6d90ae1bbbc6]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] <== disconnect_volume: return (280ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:19:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Deleting instance files /opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779_del
Aug 16 17:19:33 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Deletion of /opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779_del complete
Aug 16 17:19:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-4d3244df-a6d1-493f-8758-49f07a4a27c4 req-5573f506-1108-4c6f-ad9e-51d7908e1fc7 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4d3244df-a6d1-493f-8758-49f07a4a27c4 req-5573f506-1108-4c6f-ad9e-51d7908e1fc7 service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4d3244df-a6d1-493f-8758-49f07a4a27c4 req-5573f506-1108-4c6f-ad9e-51d7908e1fc7 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-4d3244df-a6d1-493f-8758-49f07a4a27c4 req-5573f506-1108-4c6f-ad9e-51d7908e1fc7 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG nova.compute.manager [req-4d3244df-a6d1-493f-8758-49f07a4a27c4 req-5573f506-1108-4c6f-ad9e-51d7908e1fc7 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:19:33 user nova-compute[73450]: WARNING nova.compute.manager [req-4d3244df-a6d1-493f-8758-49f07a4a27c4 req-5573f506-1108-4c6f-ad9e-51d7908e1fc7 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state active and task_state shelving.
Aug 16 17:19:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated VIF entry in instance network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG nova.network.neutron [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": null, "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape3f8ddac-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:19:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-2e681bc1-03c4-4fed-bdb5-bee2c3e38609 req-2389a2ba-900c-43a6-9ae1-27a86bff6982 service nova] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:19:34 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Deleted allocations for instance 289e099e-6904-48d0-beb9-00ef803da779
Aug 16 17:19:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:19:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:19:34 user nova-compute[73450]: DEBUG nova.objects.instance [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'numa_topology' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:19:34 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:19:34 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:19:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:19:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-1c448cfd-c871-4d6a-a4eb-d2c7f92feff6 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.567s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:19:35 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:45 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:46 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692206371.772227, 289e099e-6904-48d0-beb9-00ef803da779 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:19:46 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] VM Stopped (Lifecycle Event)
Aug 16 17:19:46 user nova-compute[73450]: DEBUG nova.compute.manager [None req-5859d5c3-c2b2-45b2-88ee-85ecc8a3faf9 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:19:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:19:57 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:00 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:02 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:12 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:17 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:20:18 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:20:18 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=23.91141128540039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing inventories for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating ProviderTree inventory for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Updating inventory in ProviderTree for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing aggregate associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, aggregates: None {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Refreshing trait associations for resource provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING {{(pid=73450) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:20:18 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:20:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:20 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:22 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:24 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:20:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:20:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:27 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:20:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:32 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:37 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 17:20:37 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] There are 0 instances to clean {{(pid=73450) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 17:20:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:38 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:20:38 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73450) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 17:20:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:20:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:42 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:47 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:20:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:20:52 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:20:53 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:20:58 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:21:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:21:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:21:03 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:08 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:17 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:18 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:18 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:21:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:21:18 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:21:19 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:21:19 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=23.91012954711914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:21:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:20 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:20 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:21 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:21 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:22 user nova-compute[73450]: INFO nova.compute.manager [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Unshelving
Aug 16 17:21:22 user nova-compute[73450]: INFO nova.virt.block_device [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Booting with volume 9a5f469e-40fb-4dbb-854f-fa74bb8b8736 at /dev/vda
Aug 16 17:21:22 user nova-compute[73450]: DEBUG os_brick.utils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a50c698-1d84-4579-abb6-181f0bfdd626]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:717d21b501b\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84a1f63-bfb9-4547-b528-6aa14bd84e68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef54970-2ff8-42b8-b456-9cd9e1dc82c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0528eb-af88-48fa-864b-866336bb107c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:22 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Running cmd (subprocess): nvme version {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] 'nvme version' failed. Not Retrying. {{(pid=73450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.nvmeof [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] nvme not present on system {{(pid=73450) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 17:21:23 user nova-compute[73450]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 17:21:23 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee256fff-c071-464d-9a72-be19c2acf0f5]: (4, '') {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73450) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.lightos [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] LIGHTOS: no hostnqn found. {{(pid=73450) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG os_brick.utils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:717d21b501b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:21:23 user nova-compute[73450]: DEBUG nova.virt.block_device [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating existing volume attachment record: 023df9b5-f15f-4572-a0b8-134732d54cc6 {{(pid=73450) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 17:21:24 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:21:25 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:21:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:21:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:21:28 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:31 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'pci_requests' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG nova.objects.instance [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'numa_topology' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73450) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 17:21:33 user nova-compute[73450]: INFO nova.compute.claims [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Claim successful on node user
Aug 16 17:21:33 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:33 user nova-compute[73450]: INFO nova.network.neutron [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 17:21:33 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Building network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.compute.manager [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing instance network info cache due to event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.network.neutron [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Creating instance directory {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 17:21:34 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Creating image(s)
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Did not create local disks {{(pid=73450) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Ensure instance console log exists: /opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779/console.log {{(pid=73450) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Start _get_guest_xml network_info=[{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '023df9b5-f15f-4572-a0b8-134732d54cc6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '289e099e-6904-48d0-beb9-00ef803da779', 'attached_at': '', 'detached_at': '', 'volume_id': '9a5f469e-40fb-4dbb-854f-fa74bb8b8736', 'serial': '9a5f469e-40fb-4dbb-854f-fa74bb8b8736'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.network.neutron [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:21:34 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:21:34 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] CPU controller missing on host. {{(pid=73450) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.host [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] CPU controller found on host. {{(pid=73450) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73450) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T16:34:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Flavor limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Image limits 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Flavor pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Image pref 0:0:0 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Got 1 possible topologies {{(pid=73450) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.hardware [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73450) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.objects.instance [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Calling os-brick to attach iSCSI Volume {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:21:34 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:21:34 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:21:34 user nova-compute[73450]: INFO os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[761f441b-5d6d-4fcf-8616-353dac8b169f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 17:21:34 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --interface default --op new {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0d14b9-f128-4bb5-af18-6f08fdb884f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736] added\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736] added
Aug 16 17:21:34 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3421a0e7-f208-449d-b1e2-9403110fc50e]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da70142f-ad95-42f9-9bd9-1921d5b5e9aa]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjpBorHs {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjpBorHs" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a255b7ff-aa21-4b18-a001-d3689f8ed97b]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjpBorHs'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fccbb2-e4e6-4086-aede-6be963dc08bb]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e8722-0df4-4004-b379-0810f9aebfcb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:21:34 user nova-compute[73450]:  {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:21:34 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 17:21:34 user nova-compute[73450]:  {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:21:34 user nova-compute[73450]: WARNING os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 17:21:34 user nova-compute[73450]: 
Aug 16 17:21:34 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --login {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a609adf8-0b50-41b0-9a85-c4b4ab411222]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]
Aug 16 17:21:35 user nova-compute[73450]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.
Aug 16 17:21:35 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ed06f-faf8-4256-b2a4-2307ddd1b185]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fa5449-ff3a-42b3-9524-e69c4b8a7599]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:21:35 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:21:35 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Connected to 172.16.0.220:3260 {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73450) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73450) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951d2f3-0617-4bc2-80d5-40b371c0df8f]: (4, ('- - 0', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73450) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73450) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated VIF entry in instance network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG nova.network.neutron [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:21:35 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-dfe6009c-5140-4d70-ab93-5f33b5343fc9 req-c183fabb-d095-4032-8e91-3dc0a02971a0 service nova] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23466626331333338', 'path': '/dev/sdb'} {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466626331333338', 'path': '/dev/sdb'} {{(pid=73450) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1548028814',display_name='tempest-TestShelveInstance-server-1548028814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1548028814',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1066272739',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='62fc377c07124027a15cb195f0f776fc',ramdisk_id='',reservation_id='r-w6ofuokq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1118976337',owner_user_name='tempest-TestShelveInstance-1118976337-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:21:23Z,user_data=None,user_id='56f1e5a175be4568af6dbdf137ec9b78',uuid=289e099e-6904-48d0-beb9-00ef803da779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73450) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converting VIF {"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.objects.instance [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'pci_devices' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] End _get_guest_xml xml=<domain type="kvm">
Aug 16 17:21:36 user nova-compute[73450]:   <uuid>289e099e-6904-48d0-beb9-00ef803da779</uuid>
Aug 16 17:21:36 user nova-compute[73450]:   <name>instance-00000034</name>
Aug 16 17:21:36 user nova-compute[73450]:   <memory>524288</memory>
Aug 16 17:21:36 user nova-compute[73450]:   <vcpu>1</vcpu>
Aug 16 17:21:36 user nova-compute[73450]:   <metadata>
Aug 16 17:21:36 user nova-compute[73450]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 17:21:36 user nova-compute[73450]:       <nova:package version="0.0.0"/>
Aug 16 17:21:36 user nova-compute[73450]:       <nova:name>tempest-TestShelveInstance-server-1548028814</nova:name>
Aug 16 17:21:36 user nova-compute[73450]:       <nova:creationTime>2023-08-16 17:21:34</nova:creationTime>
Aug 16 17:21:36 user nova-compute[73450]:       <nova:flavor name="m1.tiny">
Aug 16 17:21:36 user nova-compute[73450]:         <nova:memory>512</nova:memory>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:disk>1</nova:disk>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:swap>0</nova:swap>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:vcpus>1</nova:vcpus>
Aug 16 17:21:36 user nova-compute[73450]:       </nova:flavor>
Aug 16 17:21:36 user nova-compute[73450]:       <nova:owner>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:user uuid="56f1e5a175be4568af6dbdf137ec9b78">tempest-TestShelveInstance-1118976337-project-member</nova:user>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:project uuid="62fc377c07124027a15cb195f0f776fc">tempest-TestShelveInstance-1118976337</nova:project>
Aug 16 17:21:36 user nova-compute[73450]:       </nova:owner>
Aug 16 17:21:36 user nova-compute[73450]:       <nova:ports>
Aug 16 17:21:36 user nova-compute[73450]:         <nova:port uuid="e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161">
Aug 16 17:21:36 user nova-compute[73450]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 17:21:36 user nova-compute[73450]:         </nova:port>
Aug 16 17:21:36 user nova-compute[73450]:       </nova:ports>
Aug 16 17:21:36 user nova-compute[73450]:     </nova:instance>
Aug 16 17:21:36 user nova-compute[73450]:   </metadata>
Aug 16 17:21:36 user nova-compute[73450]:   <sysinfo type="smbios">
Aug 16 17:21:36 user nova-compute[73450]:     <system>
Aug 16 17:21:36 user nova-compute[73450]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 17:21:36 user nova-compute[73450]:       <entry name="product">OpenStack Nova</entry>
Aug 16 17:21:36 user nova-compute[73450]:       <entry name="version">0.0.0</entry>
Aug 16 17:21:36 user nova-compute[73450]:       <entry name="serial">289e099e-6904-48d0-beb9-00ef803da779</entry>
Aug 16 17:21:36 user nova-compute[73450]:       <entry name="uuid">289e099e-6904-48d0-beb9-00ef803da779</entry>
Aug 16 17:21:36 user nova-compute[73450]:       <entry name="family">Virtual Machine</entry>
Aug 16 17:21:36 user nova-compute[73450]:     </system>
Aug 16 17:21:36 user nova-compute[73450]:   </sysinfo>
Aug 16 17:21:36 user nova-compute[73450]:   <os>
Aug 16 17:21:36 user nova-compute[73450]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 17:21:36 user nova-compute[73450]:     <boot dev="hd"/>
Aug 16 17:21:36 user nova-compute[73450]:     <smbios mode="sysinfo"/>
Aug 16 17:21:36 user nova-compute[73450]:   </os>
Aug 16 17:21:36 user nova-compute[73450]:   <features>
Aug 16 17:21:36 user nova-compute[73450]:     <acpi/>
Aug 16 17:21:36 user nova-compute[73450]:     <apic/>
Aug 16 17:21:36 user nova-compute[73450]:     <vmcoreinfo/>
Aug 16 17:21:36 user nova-compute[73450]:   </features>
Aug 16 17:21:36 user nova-compute[73450]:   <clock offset="utc">
Aug 16 17:21:36 user nova-compute[73450]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 17:21:36 user nova-compute[73450]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 17:21:36 user nova-compute[73450]:     <timer name="hpet" present="no"/>
Aug 16 17:21:36 user nova-compute[73450]:   </clock>
Aug 16 17:21:36 user nova-compute[73450]:   <cpu mode="custom" match="exact">
Aug 16 17:21:36 user nova-compute[73450]:     <model>Nehalem</model>
Aug 16 17:21:36 user nova-compute[73450]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 17:21:36 user nova-compute[73450]:   </cpu>
Aug 16 17:21:36 user nova-compute[73450]:   <devices>
Aug 16 17:21:36 user nova-compute[73450]:     <disk type="block" device="disk">
Aug 16 17:21:36 user nova-compute[73450]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 17:21:36 user nova-compute[73450]:       <source dev="/dev/sdb"/>
Aug 16 17:21:36 user nova-compute[73450]:       <target dev="vda" bus="virtio"/>
Aug 16 17:21:36 user nova-compute[73450]:       <serial>9a5f469e-40fb-4dbb-854f-fa74bb8b8736</serial>
Aug 16 17:21:36 user nova-compute[73450]:     </disk>
Aug 16 17:21:36 user nova-compute[73450]:     <interface type="ethernet">
Aug 16 17:21:36 user nova-compute[73450]:       <mac address="fa:16:3e:ea:2a:91"/>
Aug 16 17:21:36 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:21:36 user nova-compute[73450]:       <mtu size="1442"/>
Aug 16 17:21:36 user nova-compute[73450]:       <target dev="tape3f8ddac-46"/>
Aug 16 17:21:36 user nova-compute[73450]:     </interface>
Aug 16 17:21:36 user nova-compute[73450]:     <serial type="pty">
Aug 16 17:21:36 user nova-compute[73450]:       <log file="/opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779/console.log" append="off"/>
Aug 16 17:21:36 user nova-compute[73450]:     </serial>
Aug 16 17:21:36 user nova-compute[73450]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 17:21:36 user nova-compute[73450]:     <video>
Aug 16 17:21:36 user nova-compute[73450]:       <model type="virtio"/>
Aug 16 17:21:36 user nova-compute[73450]:     </video>
Aug 16 17:21:36 user nova-compute[73450]:     <rng model="virtio">
Aug 16 17:21:36 user nova-compute[73450]:       <backend model="random">/dev/urandom</backend>
Aug 16 17:21:36 user nova-compute[73450]:     </rng>
Aug 16 17:21:36 user nova-compute[73450]:     <controller type="usb" index="0" model="none"/>
Aug 16 17:21:36 user nova-compute[73450]:     <memballoon model="virtio">
Aug 16 17:21:36 user nova-compute[73450]:       <stats period="10"/>
Aug 16 17:21:36 user nova-compute[73450]:     </memballoon>
Aug 16 17:21:36 user nova-compute[73450]:   </devices>
Aug 16 17:21:36 user nova-compute[73450]: </domain>
Aug 16 17:21:36 user nova-compute[73450]:  {{(pid=73450) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1548028814',display_name='tempest-TestShelveInstance-server-1548028814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1548028814',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1066272739',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='62fc377c07124027a15cb195f0f776fc',ramdisk_id='',reservation_id='r-w6ofuokq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1118976337',owner_user_name='tempest-TestShelveInstance-1118976337-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:21:23Z,user_data=None,user_id='56f1e5a175be4568af6dbdf137ec9b78',uuid=289e099e-6904-48d0-beb9-00ef803da779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converting VIF {"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG os_vif [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3f8ddac-46, may_exist=True, interface_attrs={}) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3f8ddac-46, col_values=(('external_ids', {'iface-id': 'e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:2a:91', 'vm-uuid': '289e099e-6904-48d0-beb9-00ef803da779'}),), if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:36 user nova-compute[73450]: INFO os_vif [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46')
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] No BDM found with device name vda, not building metadata. {{(pid=73450) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 17:21:36 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] No VIF found with MAC fa:16:3e:ea:2a:91, not building metadata {{(pid=73450) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-f1141573-73b1-414d-a9c5-f0b04b20e29c req-42556f8d-1e5c-4e74-aa1e-4036927ace0a service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f1141573-73b1-414d-a9c5-f0b04b20e29c req-42556f8d-1e5c-4e74-aa1e-4036927ace0a service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f1141573-73b1-414d-a9c5-f0b04b20e29c req-42556f8d-1e5c-4e74-aa1e-4036927ace0a service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-f1141573-73b1-414d-a9c5-f0b04b20e29c req-42556f8d-1e5c-4e74-aa1e-4036927ace0a service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:37 user nova-compute[73450]: DEBUG nova.compute.manager [req-f1141573-73b1-414d-a9c5-f0b04b20e29c req-42556f8d-1e5c-4e74-aa1e-4036927ace0a service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:21:37 user nova-compute[73450]: WARNING nova.compute.manager [req-f1141573-73b1-414d-a9c5-f0b04b20e29c req-42556f8d-1e5c-4e74-aa1e-4036927ace0a service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 17:21:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:38 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206499.6378944, 289e099e-6904-48d0-beb9-00ef803da779 => Resumed> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:21:39 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] VM Resumed (Lifecycle Event)
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance event wait completed in 0 seconds for  {{(pid=73450) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Guest created on hypervisor {{(pid=73450) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 17:21:39 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance spawned successfully.
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:21:39 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.virt.driver [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] Emitting event <LifecycleEvent: 1692206499.6415956, 289e099e-6904-48d0-beb9-00ef803da779 => Started> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:21:39 user nova-compute[73450]: INFO nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] VM Started (Lifecycle Event)
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-365c6281-daa4-4a95-a952-3d85a4d420db tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.097s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [None req-da439329-f670-4e31-86ba-81eab8930a84 None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73450) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-bdb5bbc5-8d75-4f80-93fd-e28686d0d6d0 req-99e93957-9274-4423-878d-116d4ba53328 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bdb5bbc5-8d75-4f80-93fd-e28686d0d6d0 req-99e93957-9274-4423-878d-116d4ba53328 service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bdb5bbc5-8d75-4f80-93fd-e28686d0d6d0 req-99e93957-9274-4423-878d-116d4ba53328 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-bdb5bbc5-8d75-4f80-93fd-e28686d0d6d0 req-99e93957-9274-4423-878d-116d4ba53328 service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:21:39 user nova-compute[73450]: DEBUG nova.compute.manager [req-bdb5bbc5-8d75-4f80-93fd-e28686d0d6d0 req-99e93957-9274-4423-878d-116d4ba53328 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:21:39 user nova-compute[73450]: WARNING nova.compute.manager [req-bdb5bbc5-8d75-4f80-93fd-e28686d0d6d0 req-99e93957-9274-4423-878d-116d4ba53328 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state active and task_state None.
Aug 16 17:21:40 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:21:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:55 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:21:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:00 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:05 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:16 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73450) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 17:22:19 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:22:19 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=23.908306121826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Instance 289e099e-6904-48d0-beb9-00ef803da779 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73450) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:22:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Forcefully refreshing network info cache for instance {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 17:22:20 user nova-compute[73450]: DEBUG nova.objects.instance [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lazy-loading 'info_cache' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:22:21 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:22:21 user nova-compute[73450]: DEBUG nova.network.neutron [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:22:21 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:22:21 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated the network info_cache for instance {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 17:22:21 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:24 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:22:26 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:22:26 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:22:31 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:22:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:22:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:22:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:22:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:22:36 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:41 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:46 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:22:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:22:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:22:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:22:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:22:51 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:22:56 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:23:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:23:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:23:01 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:06 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:23:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:23:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:23:11 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG nova.compute.manager [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing instance network info cache due to event network-changed-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] Acquiring lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] Acquired lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG nova.network.neutron [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Refreshing network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:13 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:13 user nova-compute[73450]: INFO nova.compute.manager [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Terminating instance
Aug 16 17:23:13 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Start destroying the instance on the hypervisor. {{(pid=73450) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.network.neutron [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updated VIF entry in instance network info cache for port e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161. {{(pid=73450) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.network.neutron [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [{"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-d5f4b6d1-9cd7-406c-8ca7-81b47a07a7aa req-78406f98-2ade-4639-a144-063a11eba0a5 service nova] Releasing lock "refresh_cache-289e099e-6904-48d0-beb9-00ef803da779" {{(pid=73450) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: INFO nova.virt.libvirt.driver [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Instance destroyed successfully.
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.objects.instance [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lazy-loading 'resources' on Instance uuid 289e099e-6904-48d0-beb9-00ef803da779 {{(pid=73450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.vif [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1548028814',display_name='tempest-TestShelveInstance-server-1548028814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1548028814',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEg1RA7BWmGAZ9ksizXdsQlZvbkQMy9T7CtI1FahCapmwzHjedOSUFCmSYuxZmDadFvoV3sVtTw0rEbTlIjaK9JEx892u6XfErE9cPvB1vXaMcXs9WgwAmm88PyHJOorw==',key_name='tempest-TestShelveInstance-1066272739',keypairs=<?>,launch_index=0,launched_at=2023-08-16T17:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62fc377c07124027a15cb195f0f776fc',ramdisk_id='',reservation_id='r-w6ofuokq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1118976337',owner_user_name='tempest-TestShelveInstance-1118976337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T17:21:40Z,user_data=None,user_id='56f1e5a175be4568af6dbdf137ec9b78',uuid=289e099e-6904-48d0-beb9-00ef803da779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converting VIF {"id": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "address": "fa:16:3e:ea:2a:91", "network": {"id": "e8fe63a7-ddf9-4392-b88d-58e07b32ac5e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747728158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62fc377c07124027a15cb195f0f776fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f8ddac-46", "ovs_interfaceid": "e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.network.os_vif_util [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_vif [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46') {{(pid=73450) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3f8ddac-46, bridge=br-int, if_exists=True) {{(pid=73450) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:14 user nova-compute[73450]: INFO os_vif [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:2a:91,bridge_name='br-int',has_traffic_filtering=True,id=e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161,network=Network(e8fe63a7-ddf9-4392-b88d-58e07b32ac5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f8ddac-46')
Aug 16 17:23:14 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] calling os-brick to detach iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe2707c4f40>, {'target_iqns': ['iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjpBorHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 17:23:14 user nova-compute[73450]: WARNING os_brick.initiator.connectors.base [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736', 0)] {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8c1e5-83ca-4f37-baf1-77565a7c6bad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5aed5a-7f6a-4f4f-b546-b969ce438b27]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:23:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 (non-flash)
Aug 16 17:23:14 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe270196b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736'): ({'sdb'}, set())}) {{(pid=73450) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Removing single pathed devices sdb {{(pid=73450) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[43131fff-80d4-44e4-8fcc-3d849e52b12c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da5bd0-e904-464b-9b39-95cd92092664]: (4, ('ok\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Flushing IO for device /dev/sdb {{(pid=73450) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 17:23:14 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[648cc9a9-a284-4700-8238-df9b041bed89]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73450) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b1a056-95d5-4181-b25b-ddca3b889f6c]: (4, ('1', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.linuxscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] SCSI volumes sdb have been removed. {{(pid=73450) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736')] {{(pid=73450) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f283d25-8fdf-4de5-85ff-b8e778f210b7]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --logout {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d4555-6a0d-4179-8b87-8d38e5903af3]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260]
Aug 16 17:23:15 user nova-compute[73450]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736, portal: 172.16.0.220,3260] successful.
Aug 16 17:23:15 user nova-compute[73450]:  stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op delete {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5f469e-40fb-4dbb-854f-fa74bb8b8736 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb0bdf-0db7-4dbc-a49b-8a73c17ceb78]: (4, ('', '')) {{(pid=84237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73450) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.base [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] <== disconnect_volume: return (325ms) None {{(pid=73450) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Disconnected iSCSI Volume {{(pid=73450) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 17:23:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Deleting instance files /opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779_del
Aug 16 17:23:15 user nova-compute[73450]: INFO nova.virt.libvirt.driver [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Deletion of /opt/stack/data/nova/instances/289e099e-6904-48d0-beb9-00ef803da779_del complete
Aug 16 17:23:15 user nova-compute[73450]: INFO nova.compute.manager [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo.service.loopingcall [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73450) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Deallocating network for instance {{(pid=73450) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] deallocate_for_instance() {{(pid=73450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.network.neutron [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Updating instance_info_cache with network_info: [] {{(pid=73450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-unplugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-unplugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-unplugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with task_state deleting. {{(pid=73450) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] Acquiring lock "289e099e-6904-48d0-beb9-00ef803da779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] Lock "289e099e-6904-48d0-beb9-00ef803da779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] No waiting events found dispatching network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 17:23:15 user nova-compute[73450]: WARNING nova.compute.manager [req-36c1985f-425b-4aee-9d36-244d46fae916 req-a7752133-29d3-4075-990d-c9a80d36175c service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received unexpected event network-vif-plugged-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 for instance with vm_state active and task_state deleting.
Aug 16 17:23:15 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Took 0.59 seconds to deallocate network for instance.
Aug 16 17:23:15 user nova-compute[73450]: DEBUG nova.compute.manager [req-3a24117a-7345-4f6f-837e-b2e441c18e7f req-4393e0e2-9940-4f2c-aa74-5bc7611afa19 service nova] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Received event network-vif-deleted-e3f8ddac-46a8-49bd-9a6b-9fbe8daf4161 {{(pid=73450) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 17:23:16 user nova-compute[73450]: INFO nova.compute.manager [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 17:23:16 user nova-compute[73450]: DEBUG nova.compute.manager [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Deleting volume: 9a5f469e-40fb-4dbb-854f-fa74bb8b8736 {{(pid=73450) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 17:23:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:16 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:23:16 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:23:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:16 user nova-compute[73450]: INFO nova.scheduler.client.report [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Deleted allocations for instance 289e099e-6904-48d0-beb9-00ef803da779
Aug 16 17:23:16 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-fc574b19-8ee9-4ac4-b9da-b02b132aff06 tempest-TestShelveInstance-1118976337 tempest-TestShelveInstance-1118976337-project-member] Lock "289e099e-6904-48d0-beb9-00ef803da779" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:23:19 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:23:19 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=23.907512664794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:23:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:22 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:23:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:23:22 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:23:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:23:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:23:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:23:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:25 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:25 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:25 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:23:28 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:29 user nova-compute[73450]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692206594.802932, 289e099e-6904-48d0-beb9-00ef803da779 => Stopped> {{(pid=73450) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 17:23:29 user nova-compute[73450]: INFO nova.compute.manager [-] [instance: 289e099e-6904-48d0-beb9-00ef803da779] VM Stopped (Lifecycle Event)
Aug 16 17:23:29 user nova-compute[73450]: DEBUG nova.compute.manager [None req-f7e6a3e6-42b1-4ad0-a30b-72b88d8d41dc None None] [instance: 289e099e-6904-48d0-beb9-00ef803da779] Checking state {{(pid=73450) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 17:23:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:33 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:23:34 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:23:39 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:44 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:49 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:54 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:23:59 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:04 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:07 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:09 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:10 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:14 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:19 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:19 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Auditing locally available compute resources for user (node: user) {{(pid=73450) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:24:20 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:24:20 user nova-compute[73450]: WARNING nova.virt.libvirt.driver [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Hypervisor/Node resource view: name=user free_ram=9070MB free_disk=23.904903411865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73450) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73450) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.compute.provider_tree [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed in ProviderTree for provider: 3f5625a5-ed70-4d17-8b42-ff2951fa276d {{(pid=73450) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.scheduler.client.report [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Inventory has not changed for provider 3f5625a5-ed70-4d17-8b42-ff2951fa276d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73450) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG nova.compute.resource_tracker [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Compute_service record updated for user:user {{(pid=73450) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:24:20 user nova-compute[73450]: DEBUG oslo_concurrency.lockutils [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=73450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:24:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:23 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Starting heal instance info cache {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Rebuilding the list of instances to heal {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Didn't find any instances for network info cache update. {{(pid=73450) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73450) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73450) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 17:24:24 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 17:24:25 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:26 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:26 user nova-compute[73450]: DEBUG nova.compute.manager [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73450) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:24:28 user nova-compute[73450]: DEBUG oslo_service.periodic_task [None req-9704ad0f-686c-4b00-9880-e7d37c07f33f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:24:29 user nova-compute[73450]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73450) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}